2026-03-29 12:00:06 [scrapy.utils.log] INFO: Scrapy 2.11.2 started (bot: SourcingV2)
2026-03-29 12:00:06 [scrapy.utils.log] INFO: Versions: lxml 5.2.2.0, libxml2 2.12.6, cssselect 1.2.0, parsel 1.9.1, w3lib 2.1.2, Twisted 24.3.0, Python 3.11.2 (main, Mar 13 2023, 12:18:29) [GCC 12.2.0], pyOpenSSL 24.1.0 (OpenSSL 3.2.1 30 Jan 2024), cryptography 42.0.7, Platform Linux-5.15.0-1098-azure-x86_64-with-glibc2.36
2026-03-29 12:00:06 [auto1.nl] INFO: Batch mode enabled: batch 1/2
2026-03-29 12:00:06 [auto1.nl] INFO: Starting spider auto1.nl
2026-03-29 12:00:06 [scrapy.addons] INFO: Enabled addons:
[]
2026-03-29 12:00:06 [asyncio] DEBUG: Using selector: EpollSelector
2026-03-29 12:00:06 [scrapy.utils.log] DEBUG: Using reactor: twisted.internet.asyncioreactor.AsyncioSelectorReactor
2026-03-29 12:00:06 [scrapy.utils.log] DEBUG: Using asyncio event loop: asyncio.unix_events._UnixSelectorEventLoop
2026-03-29 12:00:06 [scrapy.extensions.telnet] INFO: Telnet Password: bca50a62be255c87
2026-03-29 12:00:06 [scrapy.middleware] INFO: Enabled extensions:
['scrapy.extensions.corestats.CoreStats',
 'scrapy.extensions.telnet.TelnetConsole',
 'scrapy.extensions.memusage.MemoryUsage',
 'scrapy.extensions.feedexport.FeedExporter',
 'scrapy.extensions.logstats.LogStats',
 'scrapy.extensions.closespider.CloseSpider']
2026-03-29 12:00:06 [scrapy.crawler] INFO: Overridden settings:
{'BOT_NAME': 'SourcingV2',
 'CLOSESPIDER_TIMEOUT': 7200,
 'DOWNLOAD_MAXSIZE': 52428800,
 'DOWNLOAD_WARNSIZE': 10485760,
 'FEED_EXPORT_ENCODING': 'utf-8',
 'LOG_FILE': '/var/log/scrapyd/logs/sourcing_v2/auto1.nl/task_27_2026-03-29T12_00_00.log',
 'LOG_FORMATTER': 'crawlers.log_formatter.SourcingLogFormatter',
 'MEMUSAGE_LIMIT_MB': 2048,
 'MEMUSAGE_WARNING_MB': 1536,
 'NEWSPIDER_MODULE': 'spiders',
 'REQUEST_FINGERPRINTER_CLASS': 'scrapy_zyte_api.ScrapyZyteAPIRequestFingerprinter',
 'REQUEST_FINGERPRINTER_IMPLEMENTATION': '2.7',
 'SPIDER_MODULES': ['spiders', 'auth_check'],
 'TWISTED_REACTOR': 'twisted.internet.asyncioreactor.AsyncioSelectorReactor',
 'USER_AGENT': ''}
2026-03-29 12:00:06 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2026-03-29 12:00:06 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2026-03-29 12:00:06 [scrapy.middleware] INFO: Enabled downloader middlewares:
['scrapy.downloadermiddlewares.offsite.OffsiteMiddleware',
 'scrapy.downloadermiddlewares.httpauth.HttpAuthMiddleware',
 'scrapy.downloadermiddlewares.downloadtimeout.DownloadTimeoutMiddleware',
 'scrapy.downloadermiddlewares.defaultheaders.DefaultHeadersMiddleware',
 'scrapy.downloadermiddlewares.useragent.UserAgentMiddleware',
 'scrapy_zyte_api.ScrapyZyteAPIDownloaderMiddleware',
 'scrapy.downloadermiddlewares.retry.RetryMiddleware',
 'scrapy.downloadermiddlewares.redirect.MetaRefreshMiddleware',
 'scrapy.downloadermiddlewares.httpcompression.HttpCompressionMiddleware',
 'scrapy.downloadermiddlewares.redirect.RedirectMiddleware',
 'scrapy.downloadermiddlewares.cookies.CookiesMiddleware',
 'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware',
 'scrapy.downloadermiddlewares.stats.DownloaderStats']
2026-03-29 12:00:06 [crawlers.middlewares.id_gen_middleware] INFO: Setting up IdGenerationMiddleware
2026-03-29 12:00:06 [scrapy.middleware] INFO: Enabled spider middlewares:
['scrapy.spidermiddlewares.httperror.HttpErrorMiddleware',
 'scrapy_zyte_api.ScrapyZyteAPISpiderMiddleware',
 'crawlers.middlewares.monitoring_spider_middleware.MonitoringSpiderMiddleware',
 'scrapy.spidermiddlewares.referer.RefererMiddleware',
 'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware',
 'scrapy.spidermiddlewares.depth.DepthMiddleware',
 'crawlers.middlewares.photo_download_middleware.PhotoDownloadMiddleware',
 'crawlers.middlewares.report_download_middleware.ReportDownloadMiddleware',
 'crawlers.middlewares.id_gen_middleware.IdGenMiddleware']
2026-03-29 12:00:06 [azure.identity._credentials.environment] INFO: Incomplete environment configuration for EnvironmentCredential. These variables are set: AZURE_TENANT_ID, AZURE_CLIENT_ID
2026-03-29 12:00:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-03-29 12:00:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2114
2026-03-29 12:00:06 [azure.identity._credentials.chained] INFO: DefaultAzureCredential acquired a token from WorkloadIdentityCredential
2026-03-29 12:00:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxsourcingstorageprod.table.core.windows.net:443
2026-03-29 12:00:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:00:06 [crawlers.pipelines.translation_pipeline] INFO: Loading translations for language: auto
2026-03-29 12:00:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /Translations()?$filter=PartitionKey%20eq%20%27auto%27%20and%20RowKey%20eq%20%27auto%27 HTTP/1.1" 200 None
2026-03-29 12:00:06 [crawlers.pipelines.item_rules_pipeline] INFO: Setting up ItemRules Pipeline
2026-03-29 12:00:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_location_for_country.json
2026-03-29 12:00:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: damaged_cars_from_auction_title.json
2026-03-29 12:00:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_country.json
2026-03-29 12:00:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_fr.json
2026-03-29 12:00:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_photos.json
2026-03-29 12:00:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: damaged_from_info.json
2026-03-29 12:00:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: makes_not_allowed.json
2026-03-29 12:00:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: not_operable_from_info.json
2026-03-29 12:00:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: makes_models_not_allowed.json
2026-03-29 12:00:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: keywords_from_title.json
2026-03-29 12:00:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: imported_cars.json
2026-03-29 12:00:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_currency.json
2026-03-29 12:00:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_mileage.json
2026-03-29 12:00:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: keywords_from_auction_title.json
2026-03-29 12:00:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_country_of_origin.json
2026-03-29 12:00:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_pt.json
2026-03-29 12:00:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: electric_cars.json
2026-03-29 12:00:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_color.json
2026-03-29 12:00:06 [crawlers.pipelines.post_to_api] INFO: Setting up PostToApi Pipeline pointing to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
2026-03-29 12:00:06 [scrapy.middleware] INFO: Enabled item pipelines:
['crawlers.pipelines.translation_pipeline.TranslationPipeline',
 'crawlers.pipelines.item_rules_pipeline.ItemRulesPipeline',
 'crawlers.pipelines.post_to_api.PostToApiPipeline']
2026-03-29 12:00:06 [scrapy.core.engine] INFO: Spider opened
2026-03-29 12:00:06 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2026-03-29 12:00:06 [scrapy.extensions.telnet] INFO: Telnet console listening on 127.0.0.1:6023
2026-03-29 12:00:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 142MiB
2026-03-29 12:00:06 [scrapy-playwright] INFO: Starting download handler
2026-03-29 12:00:06 [scrapy-playwright] INFO: Starting download handler
2026-03-29 12:00:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 12:00:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/home> (referer: None) ['zyte-api']
2026-03-29 12:00:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 12:00:14 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/en/merchant/signin/ajax> (referer: https://www.auto1.com/en/home) ['zyte-api']
2026-03-29 12:00:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 12:00:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/user-token/obtain-token> (referer: https://www.auto1.com/en/merchant/signin/ajax) ['zyte-api']
2026-03-29 12:00:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 12:00:16 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/en/app/user-token/obtain-token) ['zyte-api']
2026-03-29 12:00:16 [auto1.nl] INFO: Channel: 24h | Page: 0 | totalHits: 759 | hits on page: 40
2026-03-29 12:00:16 [auto1.nl] INFO: Found listing with ID: BY07410
2026-03-29 12:00:16 [auto1.nl] INFO: Found listing with ID: SE62217
2026-03-29 12:00:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:00:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SE62217%27 HTTP/1.1" 200 None
2026-03-29 12:00:16 [auto1.nl] INFO: Scrape type for SE62217: 2
2026-03-29 12:00:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9915c0d2-005b-5323-8029-ffe268817221 with identifier: SE62217
2026-03-29 12:00:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9915c0d2-005b-5323-8029-ffe268817221 with scrape type 2
2026-03-29 12:00:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9915c0d2-005b-5323-8029-ffe268817221 with scrape type 2
2026-03-29 12:00:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 9915c0d2-005b-5323-8029-ffe268817221, identifier: SE62217
2026-03-29 12:00:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 9915c0d2-005b-5323-8029-ffe268817221 with identifier: SE62217
2026-03-29 12:00:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 12:00:16 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=blue HTTP/1.1" 200 None
2026-03-29 12:00:17 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 12:00:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 12:00:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 12:00:17 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=electro HTTP/1.1" 200 None
2026-03-29 12:00:17 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 12:00:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 12:00:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 9915c0d2-005b-5323-8029-ffe268817221 with identifier: SE62217
2026-03-29 12:00:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 9915c0d2-005b-5323-8029-ffe268817221 with identifier: SE62217 to the API
2026-03-29 12:00:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 12:00:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 12:00:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 8,
 'expiration_date': '2026-03-30T15:44:16Z',
 'fuel_type': 'electro',
 'id': '9915c0d2-005b-5323-8029-ffe268817221',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SE62217',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'Ami',
 'odometer': 32207,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-09-06',
 'seller_name': None,
 'title': 'Citroen Ami electric drive 6 kW My Ami Cargo',
 'transmission': 'automatic',
 'trim': 'My  Cargo',
 'year': 2022}
2026-03-29 12:00:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:00:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SE62217%27 HTTP/1.1" 200 None
2026-03-29 12:00:17 [auto1.nl] INFO: Saving data for SE62217: {'auction_closing_time': 1774885456.0, 'created_time': 1773688384.100909, 'last_price_update_time': 1774785617.862148}
2026-03-29 12:00:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:00:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='SE62217') HTTP/1.1" 204 0
2026-03-29 12:00:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 12:00:17 [auto1.nl] INFO: Found listing with ID: YU38024
2026-03-29 12:00:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:00:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YU38024%27 HTTP/1.1" 200 None
2026-03-29 12:00:17 [auto1.nl] INFO: Scrape type for YU38024: 2
2026-03-29 12:00:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 568f8074-76fa-5f5a-bd3b-e2456a91dc16 with identifier: YU38024
2026-03-29 12:00:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 568f8074-76fa-5f5a-bd3b-e2456a91dc16 with scrape type 2
2026-03-29 12:00:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 568f8074-76fa-5f5a-bd3b-e2456a91dc16 with scrape type 2
2026-03-29 12:00:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 568f8074-76fa-5f5a-bd3b-e2456a91dc16, identifier: YU38024
2026-03-29 12:00:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 568f8074-76fa-5f5a-bd3b-e2456a91dc16 with identifier: YU38024
2026-03-29 12:00:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 12:00:18 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=red HTTP/1.1" 200 None
2026-03-29 12:00:18 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 12:00:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 12:00:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 12:00:18 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=petrol HTTP/1.1" 200 None
2026-03-29 12:00:18 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 12:00:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 12:00:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 568f8074-76fa-5f5a-bd3b-e2456a91dc16 with identifier: YU38024
2026-03-29 12:00:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 568f8074-76fa-5f5a-bd3b-e2456a91dc16 with identifier: YU38024 to the API
2026-03-29 12:00:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 12:00:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 12:00:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-30T15:15:02Z',
 'fuel_type': 'petrol',
 'id': '568f8074-76fa-5f5a-bd3b-e2456a91dc16',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YU38024',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Clio',
 'odometer': 112334,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-05-06',
 'seller_name': None,
 'title': 'Renault Clio 0.9 Energy Luxe',
 'transmission': 'manual',
 'trim': 'Luxe',
 'year': 2015}
2026-03-29 12:00:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:00:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YU38024%27 HTTP/1.1" 200 None
2026-03-29 12:00:18 [auto1.nl] INFO: Saving data for YU38024: {'auction_closing_time': 1774883702.0, 'created_time': 1773749305.406642, 'last_price_update_time': 1774785618.590314}
2026-03-29 12:00:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:00:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='YU38024') HTTP/1.1" 204 0
2026-03-29 12:00:18 [auto1.nl] INFO: Found listing with ID: KZ40216
2026-03-29 12:00:18 [auto1.nl] INFO: Found listing with ID: VD19679
2026-03-29 12:00:18 [auto1.nl] INFO: Found listing with ID: JH98357
2026-03-29 12:00:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:00:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JH98357%27 HTTP/1.1" 200 None
2026-03-29 12:00:18 [auto1.nl] INFO: Scrape type for JH98357: 2
2026-03-29 12:00:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b6929fd4-fbb5-5def-b36d-64f97912ad14 with identifier: JH98357
2026-03-29 12:00:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b6929fd4-fbb5-5def-b36d-64f97912ad14 with scrape type 2
2026-03-29 12:00:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b6929fd4-fbb5-5def-b36d-64f97912ad14 with scrape type 2
2026-03-29 12:00:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: b6929fd4-fbb5-5def-b36d-64f97912ad14, identifier: JH98357
2026-03-29 12:00:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: b6929fd4-fbb5-5def-b36d-64f97912ad14 with identifier: JH98357
2026-03-29 12:00:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 12:00:18 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=black HTTP/1.1" 200 None
2026-03-29 12:00:18 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 12:00:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 12:00:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: b6929fd4-fbb5-5def-b36d-64f97912ad14 with identifier: JH98357
2026-03-29 12:00:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: b6929fd4-fbb5-5def-b36d-64f97912ad14 with identifier: JH98357 to the API
2026-03-29 12:00:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 12:00:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 12:00:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-30T15:21:53Z',
 'fuel_type': 'petrol',
 'id': 'b6929fd4-fbb5-5def-b36d-64f97912ad14',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JH98357',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'Yaris',
 'odometer': 159756,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-02-24',
 'seller_name': None,
 'title': 'Toyota Yaris 1.0 VVT-i Comfort',
 'transmission': 'manual',
 'trim': 'Comfort',
 'year': 2015}
2026-03-29 12:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JH98357%27 HTTP/1.1" 200 None
2026-03-29 12:00:19 [auto1.nl] INFO: Saving data for JH98357: {'auction_closing_time': 1774884113.0, 'created_time': 1774526471.468998, 'last_price_update_time': 1774785619.253795}
2026-03-29 12:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='JH98357') HTTP/1.1" 204 0
2026-03-29 12:00:19 [auto1.nl] INFO: Found listing with ID: KP52767
2026-03-29 12:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KP52767%27 HTTP/1.1" 200 None
2026-03-29 12:00:19 [auto1.nl] INFO: Scrape type for KP52767: 2
2026-03-29 12:00:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d9de1d7e-d424-575c-a115-9a0d1824c3c8 with identifier: KP52767
2026-03-29 12:00:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d9de1d7e-d424-575c-a115-9a0d1824c3c8 with scrape type 2
2026-03-29 12:00:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d9de1d7e-d424-575c-a115-9a0d1824c3c8 with scrape type 2
2026-03-29 12:00:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: d9de1d7e-d424-575c-a115-9a0d1824c3c8, identifier: KP52767
2026-03-29 12:00:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: d9de1d7e-d424-575c-a115-9a0d1824c3c8 with identifier: KP52767
2026-03-29 12:00:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 12:00:19 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=gray HTTP/1.1" 200 None
2026-03-29 12:00:19 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 12:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 12:00:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: d9de1d7e-d424-575c-a115-9a0d1824c3c8 with identifier: KP52767
2026-03-29 12:00:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: d9de1d7e-d424-575c-a115-9a0d1824c3c8 with identifier: KP52767 to the API
2026-03-29 12:00:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 12:00:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 12:00:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-30T15:40:27Z',
 'fuel_type': 'petrol',
 'id': 'd9de1d7e-d424-575c-a115-9a0d1824c3c8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KP52767',
 'listing': 'auction',
 'make': 'BMW',
 'model': '1er',
 'odometer': 220004,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-12-29',
 'seller_name': None,
 'title': 'BMW 1er 116i',
 'transmission': 'manual',
 'trim': '',
 'year': 2013}
2026-03-29 12:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KP52767%27 HTTP/1.1" 200 None
2026-03-29 12:00:19 [auto1.nl] INFO: Saving data for KP52767: {'auction_closing_time': 1774885227.0, 'created_time': 1774267368.098651, 'last_price_update_time': 1774785619.871148}
2026-03-29 12:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='KP52767') HTTP/1.1" 204 0
2026-03-29 12:00:19 [auto1.nl] INFO: Found listing with ID: XW90615
2026-03-29 12:00:19 [auto1.nl] INFO: Found listing with ID: DA42701
2026-03-29 12:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:00:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DA42701%27 HTTP/1.1" 200 None
2026-03-29 12:00:19 [auto1.nl] INFO: Scrape type for DA42701: 2
2026-03-29 12:00:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cfcd95b0-8ba5-5c43-b08b-3d1d6406c8e8 with identifier: DA42701
2026-03-29 12:00:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cfcd95b0-8ba5-5c43-b08b-3d1d6406c8e8 with scrape type 2
2026-03-29 12:00:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cfcd95b0-8ba5-5c43-b08b-3d1d6406c8e8 with scrape type 2
2026-03-29 12:00:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: cfcd95b0-8ba5-5c43-b08b-3d1d6406c8e8, identifier: DA42701
2026-03-29 12:00:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: cfcd95b0-8ba5-5c43-b08b-3d1d6406c8e8 with identifier: DA42701
2026-03-29 12:00:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: cfcd95b0-8ba5-5c43-b08b-3d1d6406c8e8 with identifier: DA42701
2026-03-29 12:00:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: cfcd95b0-8ba5-5c43-b08b-3d1d6406c8e8 with identifier: DA42701 to the API
2026-03-29 12:00:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 12:00:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 12:00:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:05:30Z',
 'fuel_type': 'petrol',
 'id': 'cfcd95b0-8ba5-5c43-b08b-3d1d6406c8e8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DA42701',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 242774,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-01-13',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 1.4 TSI ACT Highline BlueMotion Tech',
 'transmission': 'manual',
 'trim': 'Highline BlueMotion Tech',
 'year': 2015}
2026-03-29 12:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DA42701%27 HTTP/1.1" 200 None
2026-03-29 12:00:20 [auto1.nl] INFO: Saving data for DA42701: {'auction_closing_time': 1774883130.0, 'created_time': 1774119701.500131, 'last_price_update_time': 1774785620.380525}
2026-03-29 12:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='DA42701') HTTP/1.1" 204 0
2026-03-29 12:00:20 [auto1.nl] INFO: Found listing with ID: KJ03037
2026-03-29 12:00:20 [auto1.nl] INFO: Found listing with ID: YC94295
2026-03-29 12:00:20 [auto1.nl] INFO: Found listing with ID: PE07058
2026-03-29 12:00:20 [auto1.nl] INFO: Found listing with ID: WC63917
2026-03-29 12:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:00:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WC63917%27 HTTP/1.1" 200 None
2026-03-29 12:00:20 [auto1.nl] INFO: Scrape type for WC63917: 2
2026-03-29 12:00:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 40aaf431-a673-5341-a6bf-57276e0979cb with identifier: WC63917
2026-03-29 12:00:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 40aaf431-a673-5341-a6bf-57276e0979cb with scrape type 2
2026-03-29 12:00:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 40aaf431-a673-5341-a6bf-57276e0979cb with scrape type 2
2026-03-29 12:00:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 40aaf431-a673-5341-a6bf-57276e0979cb, identifier: WC63917
2026-03-29 12:00:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 40aaf431-a673-5341-a6bf-57276e0979cb with identifier: WC63917
2026-03-29 12:00:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 40aaf431-a673-5341-a6bf-57276e0979cb with identifier: WC63917
2026-03-29 12:00:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 40aaf431-a673-5341-a6bf-57276e0979cb with identifier: WC63917 to the API
2026-03-29 12:00:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 12:00:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 12:00:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 163,
 'expiration_date': '2026-03-30T15:26:23Z',
 'fuel_type': 'petrol',
 'id': '40aaf431-a673-5341-a6bf-57276e0979cb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WC63917',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'CLA-Klasse',
 'odometer': 96641,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-06-14',
 'seller_name': None,
 'title': 'Mercedes-Benz CLA-Klasse CLA 200 AMG Line',
 'transmission': 'automatic',
 'trim': 'AMG Line',
 'year': 2019}
2026-03-29 12:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WC63917%27 HTTP/1.1" 200 None
2026-03-29 12:00:21 [auto1.nl] INFO: Saving data for WC63917: {'auction_closing_time': 1774884383.0, 'created_time': 1773774549.956617, 'last_price_update_time': 1774785621.392877}
2026-03-29 12:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='WC63917') HTTP/1.1" 204 0
2026-03-29 12:00:21 [auto1.nl] INFO: Found listing with ID: BW98362
2026-03-29 12:00:21 [auto1.nl] INFO: Found listing with ID: DU10654
2026-03-29 12:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:00:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DU10654%27 HTTP/1.1" 200 None
2026-03-29 12:00:21 [auto1.nl] INFO: Scrape type for DU10654: 2
2026-03-29 12:00:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ebaf84c6-a20c-5ff1-a8b7-f2300d63d373 with identifier: DU10654
2026-03-29 12:00:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ebaf84c6-a20c-5ff1-a8b7-f2300d63d373 with scrape type 2
2026-03-29 12:00:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ebaf84c6-a20c-5ff1-a8b7-f2300d63d373 with scrape type 2
2026-03-29 12:00:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: ebaf84c6-a20c-5ff1-a8b7-f2300d63d373, identifier: DU10654
2026-03-29 12:00:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: ebaf84c6-a20c-5ff1-a8b7-f2300d63d373 with identifier: DU10654
2026-03-29 12:00:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: ebaf84c6-a20c-5ff1-a8b7-f2300d63d373 with identifier: DU10654
2026-03-29 12:00:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: ebaf84c6-a20c-5ff1-a8b7-f2300d63d373 with identifier: DU10654 to the API
2026-03-29 12:00:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 12:00:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 12:00:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:56:55Z',
 'fuel_type': 'petrol',
 'id': 'ebaf84c6-a20c-5ff1-a8b7-f2300d63d373',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DU10654',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'V70',
 'odometer': 403866,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2003-07-17',
 'seller_name': None,
 'title': 'Volvo V70 2.4',
 'transmission': 'automatic',
 'trim': '',
 'year': 2003}
2026-03-29 12:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DU10654%27 HTTP/1.1" 200 None
2026-03-29 12:00:22 [auto1.nl] INFO: Saving data for DU10654: {'auction_closing_time': 1774886215.0, 'created_time': 1774551737.535687, 'last_price_update_time': 1774785622.226723}
2026-03-29 12:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='DU10654') HTTP/1.1" 204 0
2026-03-29 12:00:22 [auto1.nl] INFO: Found listing with ID: MP41726
2026-03-29 12:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MP41726%27 HTTP/1.1" 200 None
2026-03-29 12:00:22 [auto1.nl] INFO: Scrape type for MP41726: 2
2026-03-29 12:00:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 222764fa-5fed-544e-8267-317c3b06ebd9 with identifier: MP41726
2026-03-29 12:00:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 222764fa-5fed-544e-8267-317c3b06ebd9 with scrape type 2
2026-03-29 12:00:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 222764fa-5fed-544e-8267-317c3b06ebd9 with scrape type 2
2026-03-29 12:00:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 222764fa-5fed-544e-8267-317c3b06ebd9, identifier: MP41726
2026-03-29 12:00:22 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 12:00:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 222764fa-5fed-544e-8267-317c3b06ebd9 with identifier: MP41726
2026-03-29 12:00:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 222764fa-5fed-544e-8267-317c3b06ebd9 with identifier: MP41726
2026-03-29 12:00:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 222764fa-5fed-544e-8267-317c3b06ebd9 with identifier: MP41726 to the API
2026-03-29 12:00:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 12:00:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 12:00:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 163,
 'expiration_date': '2026-03-30T15:27:20Z',
 'fuel_type': 'petrol',
 'id': '222764fa-5fed-544e-8267-317c3b06ebd9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MP41726',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'E-Klasse',
 'odometer': 181881,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2003-09-24',
 'seller_name': None,
 'title': 'Mercedes-Benz E-Klasse E 200 Kompressor T Elegance',
 'transmission': 'automatic',
 'trim': 'T Elegance',
 'year': 2003}
2026-03-29 12:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MP41726%27 HTTP/1.1" 200 None
2026-03-29 12:00:22 [auto1.nl] INFO: Saving data for MP41726: {'auction_closing_time': 1774884440.0, 'created_time': 1774465239.115805, 'last_price_update_time': 1774785622.826922}
2026-03-29 12:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='MP41726') HTTP/1.1" 204 0
2026-03-29 12:00:22 [auto1.nl] INFO: Found listing with ID: HK88309
2026-03-29 12:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:00:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HK88309%27 HTTP/1.1" 200 None
2026-03-29 12:00:22 [auto1.nl] INFO: Scrape type for HK88309: 2
2026-03-29 12:00:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 21d0b72e-500c-5d8a-833a-8c8c0632b3cb with identifier: HK88309
2026-03-29 12:00:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 21d0b72e-500c-5d8a-833a-8c8c0632b3cb with scrape type 2
2026-03-29 12:00:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 21d0b72e-500c-5d8a-833a-8c8c0632b3cb with scrape type 2
2026-03-29 12:00:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 21d0b72e-500c-5d8a-833a-8c8c0632b3cb, identifier: HK88309
2026-03-29 12:00:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 21d0b72e-500c-5d8a-833a-8c8c0632b3cb with identifier: HK88309
2026-03-29 12:00:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 12:00:23 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=green HTTP/1.1" 200 None
2026-03-29 12:00:23 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 12:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 12:00:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 21d0b72e-500c-5d8a-833a-8c8c0632b3cb with identifier: HK88309
2026-03-29 12:00:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 21d0b72e-500c-5d8a-833a-8c8c0632b3cb with identifier: HK88309 to the API
2026-03-29 12:00:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 12:00:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 12:00:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 68,
 'expiration_date': '2026-03-30T15:46:53Z',
 'fuel_type': 'petrol',
 'id': '21d0b72e-500c-5d8a-833a-8c8c0632b3cb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HK88309',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'Yaris',
 'odometer': 253868,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2002-10-30',
 'seller_name': None,
 'title': 'Toyota Yaris 1.0 VVT-i',
 'transmission': 'manual',
 'trim': '',
 'year': 2002}
2026-03-29 12:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HK88309%27 HTTP/1.1" 200 None
2026-03-29 12:00:23 [auto1.nl] INFO: Saving data for HK88309: {'auction_closing_time': 1774885613.0, 'created_time': 1774551711.407288, 'last_price_update_time': 1774785623.424044}
2026-03-29 12:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='HK88309') HTTP/1.1" 204 0
2026-03-29 12:00:23 [auto1.nl] INFO: Found listing with ID: FB29349
2026-03-29 12:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FB29349%27 HTTP/1.1" 200 None
2026-03-29 12:00:23 [auto1.nl] INFO: Scrape type for FB29349: 2
2026-03-29 12:00:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e20aa573-fa94-533f-bb99-c2d5ee3c2f4a with identifier: FB29349
2026-03-29 12:00:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e20aa573-fa94-533f-bb99-c2d5ee3c2f4a with scrape type 2
2026-03-29 12:00:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e20aa573-fa94-533f-bb99-c2d5ee3c2f4a with scrape type 2
2026-03-29 12:00:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: e20aa573-fa94-533f-bb99-c2d5ee3c2f4a, identifier: FB29349
2026-03-29 12:00:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: e20aa573-fa94-533f-bb99-c2d5ee3c2f4a with identifier: FB29349
2026-03-29 12:00:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 12:00:23 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=white HTTP/1.1" 200 None
2026-03-29 12:00:23 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 12:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 12:00:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: e20aa573-fa94-533f-bb99-c2d5ee3c2f4a with identifier: FB29349
2026-03-29 12:00:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: e20aa573-fa94-533f-bb99-c2d5ee3c2f4a with identifier: FB29349 to the API
2026-03-29 12:00:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 12:00:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 12:00:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 60,
 'expiration_date': '2026-03-30T15:49:40Z',
 'fuel_type': 'petrol',
 'id': 'e20aa573-fa94-533f-bb99-c2d5ee3c2f4a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FB29349',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Fiesta',
 'odometer': 309924,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-03-20',
 'seller_name': None,
 'title': 'Ford Fiesta 1.25 Trend',
 'transmission': 'manual',
 'trim': 'Trend',
 'year': 2012}
2026-03-29 12:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FB29349%27 HTTP/1.1" 200 None
2026-03-29 12:00:23 [auto1.nl] INFO: Saving data for FB29349: {'auction_closing_time': 1774885780.0, 'created_time': 1773836978.689141, 'last_price_update_time': 1774785623.957789}
2026-03-29 12:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='FB29349') HTTP/1.1" 204 0
2026-03-29 12:00:23 [auto1.nl] INFO: Channel: 24h | Page: 1 | totalHits: 759 | hits on page: 40
2026-03-29 12:00:23 [auto1.nl] INFO: Found listing with ID: ZP63684
2026-03-29 12:00:23 [auto1.nl] INFO: Found listing with ID: TM57044
2026-03-29 12:00:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TM57044%27 HTTP/1.1" 200 None
2026-03-29 12:00:24 [auto1.nl] INFO: Scrape type for TM57044: 2
2026-03-29 12:00:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fc70a00e-a033-5a3b-b162-43e7bd43d0f5 with identifier: TM57044
2026-03-29 12:00:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fc70a00e-a033-5a3b-b162-43e7bd43d0f5 with scrape type 2
2026-03-29 12:00:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fc70a00e-a033-5a3b-b162-43e7bd43d0f5 with scrape type 2
2026-03-29 12:00:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: fc70a00e-a033-5a3b-b162-43e7bd43d0f5, identifier: TM57044
2026-03-29 12:00:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: fc70a00e-a033-5a3b-b162-43e7bd43d0f5 with identifier: TM57044
2026-03-29 12:00:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: fc70a00e-a033-5a3b-b162-43e7bd43d0f5 with identifier: TM57044
2026-03-29 12:00:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: fc70a00e-a033-5a3b-b162-43e7bd43d0f5 with identifier: TM57044 to the API
2026-03-29 12:00:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 12:00:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 12:00:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-30T15:33:19Z',
 'fuel_type': 'petrol',
 'id': 'fc70a00e-a033-5a3b-b162-43e7bd43d0f5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TM57044',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Ibiza',
 'odometer': 282409,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-03-05',
 'seller_name': None,
 'title': 'Seat Ibiza 1.6 Reference',
 'transmission': 'manual',
 'trim': 'Reference',
 'year': 2008}
2026-03-29 12:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TM57044%27 HTTP/1.1" 200 None
2026-03-29 12:00:24 [auto1.nl] INFO: Saving data for TM57044: {'auction_closing_time': 1774884799.0, 'created_time': 1774551725.569602, 'last_price_update_time': 1774785624.482258}
2026-03-29 12:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='TM57044') HTTP/1.1" 204 0
2026-03-29 12:00:24 [auto1.nl] INFO: Found listing with ID: BY07410
2026-03-29 12:00:24 [auto1.nl] INFO: Found listing with ID: SE62217
2026-03-29 12:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SE62217%27 HTTP/1.1" 200 None
2026-03-29 12:00:24 [auto1.nl] INFO: Scrape type for SE62217: 0
2026-03-29 12:00:24 [auto1.nl] INFO: Found listing with ID: YU38024
2026-03-29 12:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YU38024%27 HTTP/1.1" 200 None
2026-03-29 12:00:24 [auto1.nl] INFO: Scrape type for YU38024: 0
2026-03-29 12:00:24 [auto1.nl] INFO: Found listing with ID: KZ40216
2026-03-29 12:00:24 [auto1.nl] INFO: Found listing with ID: VD19679
2026-03-29 12:00:24 [auto1.nl] INFO: Found listing with ID: JH98357
2026-03-29 12:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JH98357%27 HTTP/1.1" 200 None
2026-03-29 12:00:24 [auto1.nl] INFO: Scrape type for JH98357: 0
2026-03-29 12:00:24 [auto1.nl] INFO: Found listing with ID: KP52767
2026-03-29 12:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KP52767%27 HTTP/1.1" 200 None
2026-03-29 12:00:24 [auto1.nl] INFO: Scrape type for KP52767: 0
2026-03-29 12:00:24 [auto1.nl] INFO: Found listing with ID: XW90615
2026-03-29 12:00:24 [auto1.nl] INFO: Found listing with ID: DA42701
2026-03-29 12:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DA42701%27 HTTP/1.1" 200 None
2026-03-29 12:00:24 [auto1.nl] INFO: Scrape type for DA42701: 0
2026-03-29 12:00:24 [auto1.nl] INFO: Found listing with ID: KJ03037
2026-03-29 12:00:24 [auto1.nl] INFO: Found listing with ID: YC94295
2026-03-29 12:00:24 [auto1.nl] INFO: Found listing with ID: PE07058
2026-03-29 12:00:24 [auto1.nl] INFO: Found listing with ID: WC63917
2026-03-29 12:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WC63917%27 HTTP/1.1" 200 None
2026-03-29 12:00:24 [auto1.nl] INFO: Scrape type for WC63917: 0
2026-03-29 12:00:24 [auto1.nl] INFO: Found listing with ID: BW98362
2026-03-29 12:00:24 [auto1.nl] INFO: Found listing with ID: DU10654
2026-03-29 12:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DU10654%27 HTTP/1.1" 200 None
2026-03-29 12:00:24 [auto1.nl] INFO: Scrape type for DU10654: 0
2026-03-29 12:00:24 [auto1.nl] INFO: Found listing with ID: MP41726
2026-03-29 12:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MP41726%27 HTTP/1.1" 200 None
2026-03-29 12:00:24 [auto1.nl] INFO: Scrape type for MP41726: 0
2026-03-29 12:00:24 [auto1.nl] INFO: Found listing with ID: HK88309
2026-03-29 12:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HK88309%27 HTTP/1.1" 200 None
2026-03-29 12:00:24 [auto1.nl] INFO: Scrape type for HK88309: 0
2026-03-29 12:00:24 [auto1.nl] INFO: Found listing with ID: FB29349
2026-03-29 12:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FB29349%27 HTTP/1.1" 200 None
2026-03-29 12:00:24 [auto1.nl] INFO: Scrape type for FB29349: 0
2026-03-29 12:00:24 [auto1.nl] INFO: Found listing with ID: ZP63684
2026-03-29 12:00:24 [auto1.nl] INFO: Found listing with ID: TM57044
2026-03-29 12:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TM57044%27 HTTP/1.1" 200 None
2026-03-29 12:00:24 [auto1.nl] INFO: Scrape type for TM57044: 0
2026-03-29 12:00:24 [auto1.nl] INFO: Found listing with ID: VL80205
2026-03-29 12:00:24 [auto1.nl] INFO: Found listing with ID: NG83103
2026-03-29 12:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NG83103%27 HTTP/1.1" 200 None
2026-03-29 12:00:24 [auto1.nl] INFO: Scrape type for NG83103: 1
2026-03-29 12:00:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 12:00:24 [auto1.nl] INFO: Found listing with ID: VL80205
2026-03-29 12:00:24 [auto1.nl] INFO: Found listing with ID: NG83103
2026-03-29 12:00:24 [scrapy.dupefilters] DEBUG: Filtered duplicate request: <GET https://www.auto1.com/v1/car-details-view/NG83103/cdb8adcc-312b-4040-b112-4a289f3f9b07> - no more duplicates will be shown (see DUPEFILTER_DEBUG to show all duplicates)
2026-03-29 12:00:24 [auto1.nl] INFO: Found listing with ID: FD56899
2026-03-29 12:00:24 [auto1.nl] INFO: Found listing with ID: MW44280
2026-03-29 12:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MW44280%27 HTTP/1.1" 200 None
2026-03-29 12:00:24 [auto1.nl] INFO: Scrape type for MW44280: 2
2026-03-29 12:00:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ad8911a3-1f0e-50e0-8458-0f37ab0c3fcf with identifier: MW44280
2026-03-29 12:00:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ad8911a3-1f0e-50e0-8458-0f37ab0c3fcf with scrape type 2
2026-03-29 12:00:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ad8911a3-1f0e-50e0-8458-0f37ab0c3fcf with scrape type 2
2026-03-29 12:00:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: ad8911a3-1f0e-50e0-8458-0f37ab0c3fcf, identifier: MW44280
2026-03-29 12:00:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 12:00:24 [auto1.nl] INFO: Found listing with ID: FD56899
2026-03-29 12:00:24 [auto1.nl] INFO: Found listing with ID: MW44280
2026-03-29 12:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:00:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MW44280%27 HTTP/1.1" 200 None
2026-03-29 12:00:24 [auto1.nl] INFO: Scrape type for MW44280: 2
2026-03-29 12:00:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ad8911a3-1f0e-50e0-8458-0f37ab0c3fcf with scrape type 2
2026-03-29 12:00:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ad8911a3-1f0e-50e0-8458-0f37ab0c3fcf with scrape type 2
2026-03-29 12:00:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: ad8911a3-1f0e-50e0-8458-0f37ab0c3fcf, identifier: MW44280
2026-03-29 12:00:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: ad8911a3-1f0e-50e0-8458-0f37ab0c3fcf with identifier: MW44280
2026-03-29 12:00:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: ad8911a3-1f0e-50e0-8458-0f37ab0c3fcf with identifier: MW44280
2026-03-29 12:00:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: ad8911a3-1f0e-50e0-8458-0f37ab0c3fcf with identifier: MW44280 to the API
2026-03-29 12:00:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 12:00:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 12:00:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 158,
 'expiration_date': '2026-03-30T15:30:37Z',
 'fuel_type': 'petrol',
 'id': 'ad8911a3-1f0e-50e0-8458-0f37ab0c3fcf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MW44280',
 'listing': 'auction',
 'make': 'Chrysler',
 'model': 'Grand Voyager',
 'odometer': 272314,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '1997-05-31',
 'seller_name': None,
 'title': 'Chrysler Grand Voyager 3.3 LE',
 'transmission': 'automatic',
 'trim': 'LE',
 'year': 1997}
2026-03-29 12:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MW44280%27 HTTP/1.1" 200 None
2026-03-29 12:00:25 [auto1.nl] INFO: Saving data for MW44280: {'auction_closing_time': 1774884637.0, 'created_time': 1774551699.428745, 'last_price_update_time': 1774785625.3406}
2026-03-29 12:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='MW44280') HTTP/1.1" 204 0
2026-03-29 12:00:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: ad8911a3-1f0e-50e0-8458-0f37ab0c3fcf with identifier: MW44280
2026-03-29 12:00:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: ad8911a3-1f0e-50e0-8458-0f37ab0c3fcf with identifier: MW44280
2026-03-29 12:00:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: ad8911a3-1f0e-50e0-8458-0f37ab0c3fcf with identifier: MW44280 to the API
2026-03-29 12:00:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 12:00:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 12:00:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 158,
 'expiration_date': '2026-03-30T15:30:37Z',
 'fuel_type': 'petrol',
 'id': 'ad8911a3-1f0e-50e0-8458-0f37ab0c3fcf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MW44280',
 'listing': 'auction',
 'make': 'Chrysler',
 'model': 'Grand Voyager',
 'odometer': 272314,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '1997-05-31',
 'seller_name': None,
 'title': 'Chrysler Grand Voyager 3.3 LE',
 'transmission': 'automatic',
 'trim': 'LE',
 'year': 1997}
2026-03-29 12:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MW44280%27 HTTP/1.1" 200 None
2026-03-29 12:00:25 [auto1.nl] INFO: Saving data for MW44280: {'auction_closing_time': 1774884637.0, 'created_time': 1774551699.428745, 'last_price_update_time': 1774785625.692217}
2026-03-29 12:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='MW44280') HTTP/1.1" 204 0
2026-03-29 12:00:25 [auto1.nl] INFO: Found listing with ID: FJ96412
2026-03-29 12:00:25 [auto1.nl] INFO: Found listing with ID: YF19474
2026-03-29 12:00:25 [auto1.nl] INFO: Found listing with ID: BN75332
2026-03-29 12:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BN75332%27 HTTP/1.1" 200 None
2026-03-29 12:00:25 [auto1.nl] INFO: Scrape type for BN75332: 2
2026-03-29 12:00:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4ebbc78c-5f24-54dc-a529-fab497851a5f with identifier: BN75332
2026-03-29 12:00:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4ebbc78c-5f24-54dc-a529-fab497851a5f with scrape type 2
2026-03-29 12:00:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4ebbc78c-5f24-54dc-a529-fab497851a5f with scrape type 2
2026-03-29 12:00:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 4ebbc78c-5f24-54dc-a529-fab497851a5f, identifier: BN75332
2026-03-29 12:00:25 [auto1.nl] INFO: Found listing with ID: FJ96412
2026-03-29 12:00:25 [auto1.nl] INFO: Found listing with ID: YF19474
2026-03-29 12:00:25 [auto1.nl] INFO: Found listing with ID: BN75332
2026-03-29 12:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:00:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BN75332%27 HTTP/1.1" 200 None
2026-03-29 12:00:25 [auto1.nl] INFO: Scrape type for BN75332: 2
2026-03-29 12:00:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4ebbc78c-5f24-54dc-a529-fab497851a5f with scrape type 2
2026-03-29 12:00:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4ebbc78c-5f24-54dc-a529-fab497851a5f with scrape type 2
2026-03-29 12:00:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 4ebbc78c-5f24-54dc-a529-fab497851a5f, identifier: BN75332
2026-03-29 12:00:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 4ebbc78c-5f24-54dc-a529-fab497851a5f with identifier: BN75332
2026-03-29 12:00:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 4ebbc78c-5f24-54dc-a529-fab497851a5f with identifier: BN75332
2026-03-29 12:00:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 4ebbc78c-5f24-54dc-a529-fab497851a5f with identifier: BN75332 to the API
2026-03-29 12:00:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 12:00:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 12:00:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-30T15:33:41Z',
 'fuel_type': 'petrol',
 'id': '4ebbc78c-5f24-54dc-a529-fab497851a5f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BN75332',
 'listing': 'auction',
 'make': 'BMW',
 'model': '1er',
 'odometer': 279342,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-10-08',
 'seller_name': None,
 'title': 'BMW 1er 116i',
 'transmission': 'manual',
 'trim': '',
 'year': 2008}
2026-03-29 12:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BN75332%27 HTTP/1.1" 200 None
2026-03-29 12:00:26 [auto1.nl] INFO: Saving data for BN75332: {'auction_closing_time': 1774884821.0, 'created_time': 1774638151.099448, 'last_price_update_time': 1774785626.247884}
2026-03-29 12:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='BN75332') HTTP/1.1" 204 0
2026-03-29 12:00:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 4ebbc78c-5f24-54dc-a529-fab497851a5f with identifier: BN75332
2026-03-29 12:00:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 4ebbc78c-5f24-54dc-a529-fab497851a5f with identifier: BN75332
2026-03-29 12:00:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 4ebbc78c-5f24-54dc-a529-fab497851a5f with identifier: BN75332 to the API
2026-03-29 12:00:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 12:00:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 12:00:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-30T15:33:41Z',
 'fuel_type': 'petrol',
 'id': '4ebbc78c-5f24-54dc-a529-fab497851a5f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BN75332',
 'listing': 'auction',
 'make': 'BMW',
 'model': '1er',
 'odometer': 279342,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-10-08',
 'seller_name': None,
 'title': 'BMW 1er 116i',
 'transmission': 'manual',
 'trim': '',
 'year': 2008}
2026-03-29 12:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BN75332%27 HTTP/1.1" 200 None
2026-03-29 12:00:26 [auto1.nl] INFO: Saving data for BN75332: {'auction_closing_time': 1774884821.0, 'created_time': 1774638151.099448, 'last_price_update_time': 1774785626.534957}
2026-03-29 12:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='BN75332') HTTP/1.1" 204 0
2026-03-29 12:00:26 [auto1.nl] INFO: Found listing with ID: DW37625
2026-03-29 12:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DW37625%27 HTTP/1.1" 200 None
2026-03-29 12:00:26 [auto1.nl] INFO: Scrape type for DW37625: 1
2026-03-29 12:00:26 [auto1.nl] INFO: Found listing with ID: DW37625
2026-03-29 12:00:26 [auto1.nl] INFO: Found listing with ID: CN90357
2026-03-29 12:00:26 [auto1.nl] INFO: Found listing with ID: JG60699
2026-03-29 12:00:26 [auto1.nl] INFO: Found listing with ID: CE26691
2026-03-29 12:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CE26691%27 HTTP/1.1" 200 None
2026-03-29 12:00:26 [auto1.nl] INFO: Scrape type for CE26691: 2
2026-03-29 12:00:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0e2f8970-2c26-5b6d-88cd-de93fd8ac615 with identifier: CE26691
2026-03-29 12:00:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0e2f8970-2c26-5b6d-88cd-de93fd8ac615 with scrape type 2
2026-03-29 12:00:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0e2f8970-2c26-5b6d-88cd-de93fd8ac615 with scrape type 2
2026-03-29 12:00:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 0e2f8970-2c26-5b6d-88cd-de93fd8ac615, identifier: CE26691
2026-03-29 12:00:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 12:00:26 [auto1.nl] INFO: Found listing with ID: CN90357
2026-03-29 12:00:26 [auto1.nl] INFO: Found listing with ID: JG60699
2026-03-29 12:00:26 [auto1.nl] INFO: Found listing with ID: CE26691
2026-03-29 12:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:00:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CE26691%27 HTTP/1.1" 200 None
2026-03-29 12:00:26 [auto1.nl] INFO: Scrape type for CE26691: 2
2026-03-29 12:00:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0e2f8970-2c26-5b6d-88cd-de93fd8ac615 with scrape type 2
2026-03-29 12:00:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0e2f8970-2c26-5b6d-88cd-de93fd8ac615 with scrape type 2
2026-03-29 12:00:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 0e2f8970-2c26-5b6d-88cd-de93fd8ac615, identifier: CE26691
2026-03-29 12:00:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 0e2f8970-2c26-5b6d-88cd-de93fd8ac615 with identifier: CE26691
2026-03-29 12:00:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 0e2f8970-2c26-5b6d-88cd-de93fd8ac615 with identifier: CE26691
2026-03-29 12:00:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 0e2f8970-2c26-5b6d-88cd-de93fd8ac615 with identifier: CE26691 to the API
2026-03-29 12:00:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 12:00:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 12:00:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 82,
 'expiration_date': '2026-03-30T15:51:58Z',
 'fuel_type': 'petrol',
 'id': '0e2f8970-2c26-5b6d-88cd-de93fd8ac615',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CE26691',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Fiesta',
 'odometer': 199596,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-10-31',
 'seller_name': None,
 'title': 'Ford Fiesta 1.25 Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2008}
2026-03-29 12:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CE26691%27 HTTP/1.1" 200 None
2026-03-29 12:00:27 [auto1.nl] INFO: Saving data for CE26691: {'auction_closing_time': 1774885918.0, 'created_time': 1774551701.798766, 'last_price_update_time': 1774785627.19082}
2026-03-29 12:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='CE26691') HTTP/1.1" 204 0
2026-03-29 12:00:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 0e2f8970-2c26-5b6d-88cd-de93fd8ac615 with identifier: CE26691
2026-03-29 12:00:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 0e2f8970-2c26-5b6d-88cd-de93fd8ac615 with identifier: CE26691
2026-03-29 12:00:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 0e2f8970-2c26-5b6d-88cd-de93fd8ac615 with identifier: CE26691 to the API
2026-03-29 12:00:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 12:00:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 12:00:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 82,
 'expiration_date': '2026-03-30T15:51:58Z',
 'fuel_type': 'petrol',
 'id': '0e2f8970-2c26-5b6d-88cd-de93fd8ac615',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CE26691',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Fiesta',
 'odometer': 199596,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-10-31',
 'seller_name': None,
 'title': 'Ford Fiesta 1.25 Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2008}
2026-03-29 12:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CE26691%27 HTTP/1.1" 200 None
2026-03-29 12:00:27 [auto1.nl] INFO: Saving data for CE26691: {'auction_closing_time': 1774885918.0, 'created_time': 1774551701.798766, 'last_price_update_time': 1774785627.557527}
2026-03-29 12:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='CE26691') HTTP/1.1" 204 0
2026-03-29 12:00:27 [auto1.nl] INFO: Found listing with ID: GR22460
2026-03-29 12:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GR22460%27 HTTP/1.1" 200 None
2026-03-29 12:00:27 [auto1.nl] INFO: Scrape type for GR22460: 2
2026-03-29 12:00:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fe0374b9-a0e1-5263-a0c2-c8448f3fb80f with identifier: GR22460
2026-03-29 12:00:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fe0374b9-a0e1-5263-a0c2-c8448f3fb80f with scrape type 2
2026-03-29 12:00:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fe0374b9-a0e1-5263-a0c2-c8448f3fb80f with scrape type 2
2026-03-29 12:00:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: fe0374b9-a0e1-5263-a0c2-c8448f3fb80f, identifier: GR22460
2026-03-29 12:00:27 [auto1.nl] INFO: Found listing with ID: GR22460
2026-03-29 12:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:00:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GR22460%27 HTTP/1.1" 200 None
2026-03-29 12:00:27 [auto1.nl] INFO: Scrape type for GR22460: 2
2026-03-29 12:00:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fe0374b9-a0e1-5263-a0c2-c8448f3fb80f with scrape type 2
2026-03-29 12:00:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fe0374b9-a0e1-5263-a0c2-c8448f3fb80f with scrape type 2
2026-03-29 12:00:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: fe0374b9-a0e1-5263-a0c2-c8448f3fb80f, identifier: GR22460
2026-03-29 12:00:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: fe0374b9-a0e1-5263-a0c2-c8448f3fb80f with identifier: GR22460
2026-03-29 12:00:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: fe0374b9-a0e1-5263-a0c2-c8448f3fb80f with identifier: GR22460
2026-03-29 12:00:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: fe0374b9-a0e1-5263-a0c2-c8448f3fb80f with identifier: GR22460 to the API
2026-03-29 12:00:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 12:00:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 12:00:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 145,
 'expiration_date': '2026-03-30T15:49:22Z',
 'fuel_type': 'petrol',
 'id': 'fe0374b9-a0e1-5263-a0c2-c8448f3fb80f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GR22460',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'C-Max',
 'odometer': 226203,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-04-28',
 'seller_name': None,
 'title': 'Ford C-Max 2.0 Titanium',
 'transmission': 'automatic',
 'trim': 'Titanium',
 'year': 2009}
2026-03-29 12:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GR22460%27 HTTP/1.1" 200 None
2026-03-29 12:00:28 [auto1.nl] INFO: Saving data for GR22460: {'auction_closing_time': 1774885762.0, 'created_time': 1774638122.518145, 'last_price_update_time': 1774785628.086412}
2026-03-29 12:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='GR22460') HTTP/1.1" 204 0
2026-03-29 12:00:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: fe0374b9-a0e1-5263-a0c2-c8448f3fb80f with identifier: GR22460
2026-03-29 12:00:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: fe0374b9-a0e1-5263-a0c2-c8448f3fb80f with identifier: GR22460
2026-03-29 12:00:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: fe0374b9-a0e1-5263-a0c2-c8448f3fb80f with identifier: GR22460 to the API
2026-03-29 12:00:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 12:00:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 12:00:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 145,
 'expiration_date': '2026-03-30T15:49:22Z',
 'fuel_type': 'petrol',
 'id': 'fe0374b9-a0e1-5263-a0c2-c8448f3fb80f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GR22460',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'C-Max',
 'odometer': 226203,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-04-28',
 'seller_name': None,
 'title': 'Ford C-Max 2.0 Titanium',
 'transmission': 'automatic',
 'trim': 'Titanium',
 'year': 2009}
2026-03-29 12:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GR22460%27 HTTP/1.1" 200 None
2026-03-29 12:00:28 [auto1.nl] INFO: Saving data for GR22460: {'auction_closing_time': 1774885762.0, 'created_time': 1774638122.518145, 'last_price_update_time': 1774785628.353553}
2026-03-29 12:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='GR22460') HTTP/1.1" 204 0
2026-03-29 12:00:28 [auto1.nl] INFO: Found listing with ID: WM06162
2026-03-29 12:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WM06162%27 HTTP/1.1" 200 None
2026-03-29 12:00:28 [auto1.nl] INFO: Scrape type for WM06162: 2
2026-03-29 12:00:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f0fb6e6a-a9b3-50db-96ce-c96007f38a85 with identifier: WM06162
2026-03-29 12:00:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f0fb6e6a-a9b3-50db-96ce-c96007f38a85 with scrape type 2
2026-03-29 12:00:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f0fb6e6a-a9b3-50db-96ce-c96007f38a85 with scrape type 2
2026-03-29 12:00:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: f0fb6e6a-a9b3-50db-96ce-c96007f38a85, identifier: WM06162
2026-03-29 12:00:28 [auto1.nl] INFO: Found listing with ID: WM06162
2026-03-29 12:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WM06162%27 HTTP/1.1" 200 None
2026-03-29 12:00:28 [auto1.nl] INFO: Scrape type for WM06162: 2
2026-03-29 12:00:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f0fb6e6a-a9b3-50db-96ce-c96007f38a85 with scrape type 2
2026-03-29 12:00:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f0fb6e6a-a9b3-50db-96ce-c96007f38a85 with scrape type 2
2026-03-29 12:00:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: f0fb6e6a-a9b3-50db-96ce-c96007f38a85, identifier: WM06162
2026-03-29 12:00:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: f0fb6e6a-a9b3-50db-96ce-c96007f38a85 with identifier: WM06162
2026-03-29 12:00:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: f0fb6e6a-a9b3-50db-96ce-c96007f38a85 with identifier: WM06162
2026-03-29 12:00:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: f0fb6e6a-a9b3-50db-96ce-c96007f38a85 with identifier: WM06162 to the API
2026-03-29 12:00:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 12:00:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 12:00:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 203,
 'expiration_date': '2026-03-30T15:47:13Z',
 'fuel_type': 'petrol',
 'id': 'f0fb6e6a-a9b3-50db-96ce-c96007f38a85',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WM06162',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'S-Max',
 'odometer': 138869,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-04-21',
 'seller_name': None,
 'title': 'Ford S-Max 2.0 EcoBoost Titanium S',
 'transmission': 'automatic',
 'trim': 'Titanium S',
 'year': 2014}
2026-03-29 12:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WM06162%27 HTTP/1.1" 200 None
2026-03-29 12:00:28 [auto1.nl] INFO: Saving data for WM06162: {'auction_closing_time': 1774885633.0, 'created_time': 1773775047.480405, 'last_price_update_time': 1774785628.951178}
2026-03-29 12:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:00:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='WM06162') HTTP/1.1" 204 0
2026-03-29 12:00:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: f0fb6e6a-a9b3-50db-96ce-c96007f38a85 with identifier: WM06162
2026-03-29 12:00:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: f0fb6e6a-a9b3-50db-96ce-c96007f38a85 with identifier: WM06162
2026-03-29 12:00:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: f0fb6e6a-a9b3-50db-96ce-c96007f38a85 with identifier: WM06162 to the API
2026-03-29 12:00:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 12:00:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 12:00:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 203,
 'expiration_date': '2026-03-30T15:47:13Z',
 'fuel_type': 'petrol',
 'id': 'f0fb6e6a-a9b3-50db-96ce-c96007f38a85',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WM06162',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'S-Max',
 'odometer': 138869,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-04-21',
 'seller_name': None,
 'title': 'Ford S-Max 2.0 EcoBoost Titanium S',
 'transmission': 'automatic',
 'trim': 'Titanium S',
 'year': 2014}
2026-03-29 12:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WM06162%27 HTTP/1.1" 200 None
2026-03-29 12:00:29 [auto1.nl] INFO: Saving data for WM06162: {'auction_closing_time': 1774885633.0, 'created_time': 1773775047.480405, 'last_price_update_time': 1774785629.247472}
2026-03-29 12:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='WM06162') HTTP/1.1" 204 0
2026-03-29 12:00:29 [auto1.nl] INFO: Found listing with ID: CP88423
2026-03-29 12:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CP88423%27 HTTP/1.1" 200 None
2026-03-29 12:00:29 [auto1.nl] INFO: Scrape type for CP88423: 2
2026-03-29 12:00:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dfec76ea-b5ec-5e5a-b119-d4d79c8f197f with identifier: CP88423
2026-03-29 12:00:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dfec76ea-b5ec-5e5a-b119-d4d79c8f197f with scrape type 2
2026-03-29 12:00:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dfec76ea-b5ec-5e5a-b119-d4d79c8f197f with scrape type 2
2026-03-29 12:00:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: dfec76ea-b5ec-5e5a-b119-d4d79c8f197f, identifier: CP88423
2026-03-29 12:00:29 [auto1.nl] INFO: Found listing with ID: CP88423
2026-03-29 12:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CP88423%27 HTTP/1.1" 200 None
2026-03-29 12:00:29 [auto1.nl] INFO: Scrape type for CP88423: 2
2026-03-29 12:00:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dfec76ea-b5ec-5e5a-b119-d4d79c8f197f with scrape type 2
2026-03-29 12:00:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dfec76ea-b5ec-5e5a-b119-d4d79c8f197f with scrape type 2
2026-03-29 12:00:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: dfec76ea-b5ec-5e5a-b119-d4d79c8f197f, identifier: CP88423
2026-03-29 12:00:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: dfec76ea-b5ec-5e5a-b119-d4d79c8f197f with identifier: CP88423
2026-03-29 12:00:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: dfec76ea-b5ec-5e5a-b119-d4d79c8f197f with identifier: CP88423
2026-03-29 12:00:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: dfec76ea-b5ec-5e5a-b119-d4d79c8f197f with identifier: CP88423 to the API
2026-03-29 12:00:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 12:00:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 12:00:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:36:40Z',
 'fuel_type': 'petrol',
 'id': 'dfec76ea-b5ec-5e5a-b119-d4d79c8f197f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CP88423',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '307',
 'odometer': 227968,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-06-28',
 'seller_name': None,
 'title': 'Peugeot 307 1.6 SW',
 'transmission': 'manual',
 'trim': 'SW',
 'year': 2007}
2026-03-29 12:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CP88423%27 HTTP/1.1" 200 None
2026-03-29 12:00:29 [auto1.nl] INFO: Saving data for CP88423: {'auction_closing_time': 1774885000.0, 'created_time': 1774378898.86484, 'last_price_update_time': 1774785629.825833}
2026-03-29 12:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:00:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='CP88423') HTTP/1.1" 204 0
2026-03-29 12:00:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: dfec76ea-b5ec-5e5a-b119-d4d79c8f197f with identifier: CP88423
2026-03-29 12:00:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: dfec76ea-b5ec-5e5a-b119-d4d79c8f197f with identifier: CP88423
2026-03-29 12:00:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: dfec76ea-b5ec-5e5a-b119-d4d79c8f197f with identifier: CP88423 to the API
2026-03-29 12:00:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 12:00:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 12:00:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:36:40Z',
 'fuel_type': 'petrol',
 'id': 'dfec76ea-b5ec-5e5a-b119-d4d79c8f197f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CP88423',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '307',
 'odometer': 227968,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-06-28',
 'seller_name': None,
 'title': 'Peugeot 307 1.6 SW',
 'transmission': 'manual',
 'trim': 'SW',
 'year': 2007}
2026-03-29 12:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CP88423%27 HTTP/1.1" 200 None
2026-03-29 12:00:30 [auto1.nl] INFO: Saving data for CP88423: {'auction_closing_time': 1774885000.0, 'created_time': 1774378898.86484, 'last_price_update_time': 1774785630.133692}
2026-03-29 12:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='CP88423') HTTP/1.1" 204 0
2026-03-29 12:00:30 [auto1.nl] INFO: Found listing with ID: SG18673
2026-03-29 12:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SG18673%27 HTTP/1.1" 200 None
2026-03-29 12:00:30 [auto1.nl] INFO: Scrape type for SG18673: 2
2026-03-29 12:00:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f559aa47-9bb2-560f-ae90-8b062944e1ee with identifier: SG18673
2026-03-29 12:00:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f559aa47-9bb2-560f-ae90-8b062944e1ee with scrape type 2
2026-03-29 12:00:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f559aa47-9bb2-560f-ae90-8b062944e1ee with scrape type 2
2026-03-29 12:00:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: f559aa47-9bb2-560f-ae90-8b062944e1ee, identifier: SG18673
2026-03-29 12:00:30 [auto1.nl] INFO: Found listing with ID: SG18673
2026-03-29 12:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:00:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SG18673%27 HTTP/1.1" 200 None
2026-03-29 12:00:30 [auto1.nl] INFO: Scrape type for SG18673: 2
2026-03-29 12:00:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f559aa47-9bb2-560f-ae90-8b062944e1ee with scrape type 2
2026-03-29 12:00:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f559aa47-9bb2-560f-ae90-8b062944e1ee with scrape type 2
2026-03-29 12:00:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: f559aa47-9bb2-560f-ae90-8b062944e1ee, identifier: SG18673
2026-03-29 12:00:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: f559aa47-9bb2-560f-ae90-8b062944e1ee with identifier: SG18673
2026-03-29 12:00:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: f559aa47-9bb2-560f-ae90-8b062944e1ee with identifier: SG18673
2026-03-29 12:00:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: f559aa47-9bb2-560f-ae90-8b062944e1ee with identifier: SG18673 to the API
2026-03-29 12:00:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 12:00:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 12:00:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 80,
 'expiration_date': '2026-03-30T15:28:56Z',
 'fuel_type': 'petrol',
 'id': 'f559aa47-9bb2-560f-ae90-8b062944e1ee',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SG18673',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'Micra',
 'odometer': 139178,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2003-05-08',
 'seller_name': None,
 'title': 'Nissan Micra 1.2 Acenta',
 'transmission': 'manual',
 'trim': 'Acenta',
 'year': 2003}
2026-03-29 12:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SG18673%27 HTTP/1.1" 200 None
2026-03-29 12:00:31 [auto1.nl] INFO: Saving data for SG18673: {'auction_closing_time': 1774884536.0, 'created_time': 1773774549.425644, 'last_price_update_time': 1774785631.550409}
2026-03-29 12:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='SG18673') HTTP/1.1" 204 0
2026-03-29 12:00:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: f559aa47-9bb2-560f-ae90-8b062944e1ee with identifier: SG18673
2026-03-29 12:00:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: f559aa47-9bb2-560f-ae90-8b062944e1ee with identifier: SG18673
2026-03-29 12:00:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: f559aa47-9bb2-560f-ae90-8b062944e1ee with identifier: SG18673 to the API
2026-03-29 12:00:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 12:00:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 12:00:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 80,
 'expiration_date': '2026-03-30T15:28:56Z',
 'fuel_type': 'petrol',
 'id': 'f559aa47-9bb2-560f-ae90-8b062944e1ee',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SG18673',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'Micra',
 'odometer': 139178,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2003-05-08',
 'seller_name': None,
 'title': 'Nissan Micra 1.2 Acenta',
 'transmission': 'manual',
 'trim': 'Acenta',
 'year': 2003}
2026-03-29 12:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SG18673%27 HTTP/1.1" 200 None
2026-03-29 12:00:31 [auto1.nl] INFO: Saving data for SG18673: {'auction_closing_time': 1774884536.0, 'created_time': 1773774549.425644, 'last_price_update_time': 1774785631.833344}
2026-03-29 12:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='SG18673') HTTP/1.1" 204 0
2026-03-29 12:00:31 [auto1.nl] INFO: Found listing with ID: ZJ02157
2026-03-29 12:00:31 [auto1.nl] INFO: Found listing with ID: GX78126
2026-03-29 12:00:31 [auto1.nl] INFO: Found listing with ID: ME06294
2026-03-29 12:00:31 [auto1.nl] INFO: Found listing with ID: NN80164
2026-03-29 12:00:31 [auto1.nl] INFO: Found listing with ID: AW61305
2026-03-29 12:00:31 [auto1.nl] INFO: Found listing with ID: ZJ02157
2026-03-29 12:00:31 [auto1.nl] INFO: Found listing with ID: GX78126
2026-03-29 12:00:31 [auto1.nl] INFO: Found listing with ID: ME06294
2026-03-29 12:00:31 [auto1.nl] INFO: Found listing with ID: NN80164
2026-03-29 12:00:31 [auto1.nl] INFO: Found listing with ID: AW61305
2026-03-29 12:00:31 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 12:00:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NG83103/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 12:00:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DW37625/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 12:00:31 [auto1.nl] INFO: Channel: 24h | Page: 2 | totalHits: 759 | hits on page: 40
2026-03-29 12:00:31 [auto1.nl] INFO: Found listing with ID: LX02211
2026-03-29 12:00:31 [auto1.nl] INFO: Found listing with ID: FW01389
2026-03-29 12:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:00:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FW01389%27 HTTP/1.1" 200 None
2026-03-29 12:00:31 [auto1.nl] INFO: Scrape type for FW01389: 2
2026-03-29 12:00:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7e74020a-70a1-5c66-a76c-68c7d8f337dd with identifier: FW01389
2026-03-29 12:00:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7e74020a-70a1-5c66-a76c-68c7d8f337dd with scrape type 2
2026-03-29 12:00:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7e74020a-70a1-5c66-a76c-68c7d8f337dd with scrape type 2
2026-03-29 12:00:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 7e74020a-70a1-5c66-a76c-68c7d8f337dd, identifier: FW01389
2026-03-29 12:00:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 7e74020a-70a1-5c66-a76c-68c7d8f337dd with identifier: FW01389
2026-03-29 12:00:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 7e74020a-70a1-5c66-a76c-68c7d8f337dd with identifier: FW01389
2026-03-29 12:00:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 7e74020a-70a1-5c66-a76c-68c7d8f337dd with identifier: FW01389 to the API
2026-03-29 12:00:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 12:00:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 12:00:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 98,
 'expiration_date': '2026-03-30T15:09:56Z',
 'fuel_type': 'petrol',
 'id': '7e74020a-70a1-5c66-a76c-68c7d8f337dd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FW01389',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Modus',
 'odometer': 174142,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-02-23',
 'seller_name': None,
 'title': 'Renault Modus 1.4 Exception',
 'transmission': 'manual',
 'trim': 'Exception',
 'year': 2007}
2026-03-29 12:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FW01389%27 HTTP/1.1" 200 None
2026-03-29 12:00:32 [auto1.nl] INFO: Saving data for FW01389: {'auction_closing_time': 1774883396.0, 'created_time': 1773489728.857906, 'last_price_update_time': 1774785632.406081}
2026-03-29 12:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='FW01389') HTTP/1.1" 204 0
2026-03-29 12:00:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 12:00:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 12:00:32 [auto1.nl] INFO: Found listing with ID: PY24262
2026-03-29 12:00:32 [auto1.nl] INFO: Found listing with ID: UE59902
2026-03-29 12:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UE59902%27 HTTP/1.1" 200 None
2026-03-29 12:00:32 [auto1.nl] INFO: Scrape type for UE59902: 2
2026-03-29 12:00:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 21874000-53aa-550f-9881-22a95e15ec50 with identifier: UE59902
2026-03-29 12:00:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 21874000-53aa-550f-9881-22a95e15ec50 with scrape type 2
2026-03-29 12:00:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 21874000-53aa-550f-9881-22a95e15ec50 with scrape type 2
2026-03-29 12:00:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 21874000-53aa-550f-9881-22a95e15ec50, identifier: UE59902
2026-03-29 12:00:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 21874000-53aa-550f-9881-22a95e15ec50 with identifier: UE59902
2026-03-29 12:00:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 12:00:32 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=hybrid HTTP/1.1" 200 None
2026-03-29 12:00:32 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 12:00:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 12:00:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 21874000-53aa-550f-9881-22a95e15ec50 with identifier: UE59902
2026-03-29 12:00:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 21874000-53aa-550f-9881-22a95e15ec50 with identifier: UE59902 to the API
2026-03-29 12:00:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 12:00:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 12:00:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 261,
 'expiration_date': '2026-03-30T15:14:05Z',
 'fuel_type': 'hybrid',
 'id': '21874000-53aa-550f-9881-22a95e15ec50',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UE59902',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'XC40',
 'odometer': 187384,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-03-03',
 'seller_name': None,
 'title': 'Volvo XC40 1.5 T5 Plug-in Hybrid Momentum Pro 2WD',
 'transmission': 'automatic',
 'trim': 'Momentum Pro 2WD',
 'year': 2020}
2026-03-29 12:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UE59902%27 HTTP/1.1" 200 None
2026-03-29 12:00:33 [auto1.nl] INFO: Saving data for UE59902: {'auction_closing_time': 1774883645.0, 'created_time': 1773232015.053081, 'last_price_update_time': 1774785633.200244}
2026-03-29 12:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='UE59902') HTTP/1.1" 204 0
2026-03-29 12:00:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 12:00:33 [auto1.nl] INFO: Found listing with ID: YB25892
2026-03-29 12:00:33 [auto1.nl] INFO: Found listing with ID: DW76665
2026-03-29 12:00:33 [auto1.nl] INFO: Found listing with ID: JW20864
2026-03-29 12:00:33 [auto1.nl] INFO: Found listing with ID: DS12539
2026-03-29 12:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DS12539%27 HTTP/1.1" 200 None
2026-03-29 12:00:33 [auto1.nl] INFO: Scrape type for DS12539: 2
2026-03-29 12:00:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a7d999b2-4cbe-5518-89c1-1a68def3a899 with identifier: DS12539
2026-03-29 12:00:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a7d999b2-4cbe-5518-89c1-1a68def3a899 with scrape type 2
2026-03-29 12:00:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a7d999b2-4cbe-5518-89c1-1a68def3a899 with scrape type 2
2026-03-29 12:00:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: a7d999b2-4cbe-5518-89c1-1a68def3a899, identifier: DS12539
2026-03-29 12:00:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: a7d999b2-4cbe-5518-89c1-1a68def3a899 with identifier: DS12539
2026-03-29 12:00:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: a7d999b2-4cbe-5518-89c1-1a68def3a899 with identifier: DS12539
2026-03-29 12:00:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: a7d999b2-4cbe-5518-89c1-1a68def3a899 with identifier: DS12539 to the API
2026-03-29 12:00:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 12:00:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 12:00:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 145,
 'expiration_date': '2026-03-30T15:13:25Z',
 'fuel_type': 'petrol',
 'id': 'a7d999b2-4cbe-5518-89c1-1a68def3a899',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DS12539',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'C-Max',
 'odometer': 214910,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-02-06',
 'seller_name': None,
 'title': 'Ford C-Max 2.0 Trend',
 'transmission': 'manual',
 'trim': 'Trend',
 'year': 2007}
2026-03-29 12:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DS12539%27 HTTP/1.1" 200 None
2026-03-29 12:00:33 [auto1.nl] INFO: Saving data for DS12539: {'auction_closing_time': 1774883605.0, 'created_time': 1774638102.382682, 'last_price_update_time': 1774785633.634223}
2026-03-29 12:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='DS12539') HTTP/1.1" 204 0
2026-03-29 12:00:33 [auto1.nl] INFO: Found listing with ID: JZ35389
2026-03-29 12:00:33 [auto1.nl] INFO: Found listing with ID: RK38734
2026-03-29 12:00:33 [auto1.nl] INFO: Found listing with ID: KG10005
2026-03-29 12:00:33 [auto1.nl] INFO: Found listing with ID: LH12020
2026-03-29 12:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:00:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LH12020%27 HTTP/1.1" 200 None
2026-03-29 12:00:33 [auto1.nl] INFO: Scrape type for LH12020: 2
2026-03-29 12:00:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0917ace8-5df1-5590-94ca-594a389ead8c with identifier: LH12020
2026-03-29 12:00:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0917ace8-5df1-5590-94ca-594a389ead8c with scrape type 2
2026-03-29 12:00:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0917ace8-5df1-5590-94ca-594a389ead8c with scrape type 2
2026-03-29 12:00:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 0917ace8-5df1-5590-94ca-594a389ead8c, identifier: LH12020
2026-03-29 12:00:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 0917ace8-5df1-5590-94ca-594a389ead8c with identifier: LH12020
2026-03-29 12:00:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 0917ace8-5df1-5590-94ca-594a389ead8c with identifier: LH12020
2026-03-29 12:00:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 0917ace8-5df1-5590-94ca-594a389ead8c with identifier: LH12020 to the API
2026-03-29 12:00:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 12:00:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 12:00:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 85,
 'expiration_date': '2026-03-30T15:21:11Z',
 'fuel_type': 'petrol',
 'id': '0917ace8-5df1-5590-94ca-594a389ead8c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LH12020',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'Yaris',
 'odometer': 241962,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2000-08-20',
 'seller_name': None,
 'title': 'Toyota Yaris 1.3 VVT-i Linea Luna',
 'transmission': 'manual',
 'trim': 'Linea Luna',
 'year': 2000}
2026-03-29 12:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LH12020%27 HTTP/1.1" 200 None
2026-03-29 12:00:34 [auto1.nl] INFO: Saving data for LH12020: {'auction_closing_time': 1774884071.0, 'created_time': 1773232263.935977, 'last_price_update_time': 1774785634.123193}
2026-03-29 12:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='LH12020') HTTP/1.1" 204 0
2026-03-29 12:00:34 [auto1.nl] INFO: Found listing with ID: NA59748
2026-03-29 12:00:34 [auto1.nl] INFO: Found listing with ID: NT73578
2026-03-29 12:00:34 [auto1.nl] INFO: Found listing with ID: XW17095
2026-03-29 12:00:34 [auto1.nl] INFO: Found listing with ID: JF28004
2026-03-29 12:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JF28004%27 HTTP/1.1" 200 None
2026-03-29 12:00:34 [auto1.nl] INFO: Scrape type for JF28004: 2
2026-03-29 12:00:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 27df40ce-744c-5651-8ea7-c7b91875c664 with identifier: JF28004
2026-03-29 12:00:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 27df40ce-744c-5651-8ea7-c7b91875c664 with scrape type 2
2026-03-29 12:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 27df40ce-744c-5651-8ea7-c7b91875c664 with scrape type 2
2026-03-29 12:00:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 27df40ce-744c-5651-8ea7-c7b91875c664, identifier: JF28004
2026-03-29 12:00:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 27df40ce-744c-5651-8ea7-c7b91875c664 with identifier: JF28004
2026-03-29 12:00:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 27df40ce-744c-5651-8ea7-c7b91875c664 with identifier: JF28004
2026-03-29 12:00:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 27df40ce-744c-5651-8ea7-c7b91875c664 with identifier: JF28004 to the API
2026-03-29 12:00:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 12:00:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 12:00:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 60,
 'expiration_date': '2026-03-30T15:53:36Z',
 'fuel_type': 'petrol',
 'id': '27df40ce-744c-5651-8ea7-c7b91875c664',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JF28004',
 'listing': 'auction',
 'make': 'Smart',
 'model': 'fortwo',
 'odometer': 206099,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2005-11-08',
 'seller_name': None,
 'title': 'Smart fortwo 0.7 Turbo Basis passion',
 'transmission': 'automatic',
 'trim': 'Basis passion',
 'year': 2005}
2026-03-29 12:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JF28004%27 HTTP/1.1" 200 None
2026-03-29 12:00:34 [auto1.nl] INFO: Saving data for JF28004: {'auction_closing_time': 1774886016.0, 'created_time': 1773947350.579692, 'last_price_update_time': 1774785634.537629}
2026-03-29 12:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='JF28004') HTTP/1.1" 204 0
2026-03-29 12:00:34 [auto1.nl] INFO: Found listing with ID: MG34346
2026-03-29 12:00:34 [auto1.nl] INFO: Found listing with ID: ZE22789
2026-03-29 12:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZE22789%27 HTTP/1.1" 200 None
2026-03-29 12:00:34 [auto1.nl] INFO: Scrape type for ZE22789: 1
2026-03-29 12:00:34 [auto1.nl] INFO: Found listing with ID: ZE21436
2026-03-29 12:00:34 [auto1.nl] INFO: Found listing with ID: LW17731
2026-03-29 12:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:00:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LW17731%27 HTTP/1.1" 200 None
2026-03-29 12:00:34 [auto1.nl] INFO: Scrape type for LW17731: 2
2026-03-29 12:00:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d195d9c7-1662-5d32-845c-dddf89cb6c27 with identifier: LW17731
2026-03-29 12:00:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d195d9c7-1662-5d32-845c-dddf89cb6c27 with scrape type 2
2026-03-29 12:00:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d195d9c7-1662-5d32-845c-dddf89cb6c27 with scrape type 2
2026-03-29 12:00:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: d195d9c7-1662-5d32-845c-dddf89cb6c27, identifier: LW17731
2026-03-29 12:00:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: d195d9c7-1662-5d32-845c-dddf89cb6c27 with identifier: LW17731
2026-03-29 12:00:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: d195d9c7-1662-5d32-845c-dddf89cb6c27 with identifier: LW17731
2026-03-29 12:00:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: d195d9c7-1662-5d32-845c-dddf89cb6c27 with identifier: LW17731 to the API
2026-03-29 12:00:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 12:00:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 12:00:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 145,
 'expiration_date': '2026-03-30T15:40:48Z',
 'fuel_type': 'petrol',
 'id': 'd195d9c7-1662-5d32-845c-dddf89cb6c27',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LW17731',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Mondeo',
 'odometer': 163770,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2003-12-18',
 'seller_name': None,
 'title': 'Ford Mondeo 2.0 Trend',
 'transmission': 'automatic',
 'trim': 'Trend',
 'year': 2003}
2026-03-29 12:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LW17731%27 HTTP/1.1" 200 None
2026-03-29 12:00:35 [auto1.nl] INFO: Saving data for LW17731: {'auction_closing_time': 1774885248.0, 'created_time': 1773514907.65098, 'last_price_update_time': 1774785635.072962}
2026-03-29 12:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='LW17731') HTTP/1.1" 204 0
2026-03-29 12:00:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 12:00:35 [auto1.nl] INFO: Found listing with ID: YE49757
2026-03-29 12:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YE49757%27 HTTP/1.1" 200 None
2026-03-29 12:00:35 [auto1.nl] INFO: Scrape type for YE49757: 2
2026-03-29 12:00:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4399cde5-2731-53c5-b40d-3895a2de43db with identifier: YE49757
2026-03-29 12:00:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4399cde5-2731-53c5-b40d-3895a2de43db with scrape type 2
2026-03-29 12:00:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4399cde5-2731-53c5-b40d-3895a2de43db with scrape type 2
2026-03-29 12:00:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 4399cde5-2731-53c5-b40d-3895a2de43db, identifier: YE49757
2026-03-29 12:00:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 4399cde5-2731-53c5-b40d-3895a2de43db with identifier: YE49757
2026-03-29 12:00:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 4399cde5-2731-53c5-b40d-3895a2de43db with identifier: YE49757
2026-03-29 12:00:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 4399cde5-2731-53c5-b40d-3895a2de43db with identifier: YE49757 to the API
2026-03-29 12:00:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 12:00:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 12:00:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 68,
 'expiration_date': '2026-03-30T15:18:35Z',
 'fuel_type': 'petrol',
 'id': '4399cde5-2731-53c5-b40d-3895a2de43db',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YE49757',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '107',
 'odometer': 148840,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2006-01-09',
 'seller_name': None,
 'title': 'Peugeot 107 1.0 Petit Filou',
 'transmission': 'manual',
 'trim': 'Petit Filou',
 'year': 2006}
2026-03-29 12:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YE49757%27 HTTP/1.1" 200 None
2026-03-29 12:00:35 [auto1.nl] INFO: Saving data for YE49757: {'auction_closing_time': 1774883915.0, 'created_time': 1774551699.138066, 'last_price_update_time': 1774785635.904676}
2026-03-29 12:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='YE49757') HTTP/1.1" 204 0
2026-03-29 12:00:35 [auto1.nl] INFO: Found listing with ID: XU83484
2026-03-29 12:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XU83484%27 HTTP/1.1" 200 None
2026-03-29 12:00:35 [auto1.nl] INFO: Scrape type for XU83484: 1
2026-03-29 12:00:35 [auto1.nl] INFO: Found listing with ID: AJ89396
2026-03-29 12:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:00:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AJ89396%27 HTTP/1.1" 200 None
2026-03-29 12:00:35 [auto1.nl] INFO: Scrape type for AJ89396: 2
2026-03-29 12:00:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 69bb4fe5-7790-5c11-b0ba-6682de008784 with identifier: AJ89396
2026-03-29 12:00:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 69bb4fe5-7790-5c11-b0ba-6682de008784 with scrape type 2
2026-03-29 12:00:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 69bb4fe5-7790-5c11-b0ba-6682de008784 with scrape type 2
2026-03-29 12:00:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 69bb4fe5-7790-5c11-b0ba-6682de008784, identifier: AJ89396
2026-03-29 12:00:36 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 12:00:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DW37625> (referer: https://www.auto1.com/v1/car-details-view/DW37625/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 12:00:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NG83103> (referer: https://www.auto1.com/v1/car-details-view/NG83103/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 12:00:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 69bb4fe5-7790-5c11-b0ba-6682de008784 with identifier: AJ89396
2026-03-29 12:00:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 69bb4fe5-7790-5c11-b0ba-6682de008784 with identifier: AJ89396
2026-03-29 12:00:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 69bb4fe5-7790-5c11-b0ba-6682de008784 with identifier: AJ89396 to the API
2026-03-29 12:00:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 12:00:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 12:00:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:21:55Z',
 'fuel_type': 'petrol',
 'id': '69bb4fe5-7790-5c11-b0ba-6682de008784',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AJ89396',
 'listing': 'auction',
 'make': 'Kia',
 'model': 'Carens',
 'odometer': 177834,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2005-04-06',
 'seller_name': None,
 'title': 'Kia Carens 2.0 EX Van',
 'transmission': 'manual',
 'trim': 'EX Van',
 'year': 2005}
2026-03-29 12:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AJ89396%27 HTTP/1.1" 200 None
2026-03-29 12:00:36 [auto1.nl] INFO: Saving data for AJ89396: {'auction_closing_time': 1774884115.0, 'created_time': 1773749265.064177, 'last_price_update_time': 1774785636.426564}
2026-03-29 12:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='AJ89396') HTTP/1.1" 204 0
2026-03-29 12:00:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 12:00:36 [auto1.nl] INFO: Found listing with ID: NY98170
2026-03-29 12:00:36 [auto1.nl] INFO: Found listing with ID: YV60983
2026-03-29 12:00:36 [auto1.nl] INFO: Found listing with ID: GK27630
2026-03-29 12:00:36 [auto1.nl] INFO: Found listing with ID: MW67597
2026-03-29 12:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MW67597%27 HTTP/1.1" 200 None
2026-03-29 12:00:36 [auto1.nl] INFO: Scrape type for MW67597: 2
2026-03-29 12:00:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5b21a97e-a144-5cdd-a610-f712529497ca with identifier: MW67597
2026-03-29 12:00:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5b21a97e-a144-5cdd-a610-f712529497ca with scrape type 2
2026-03-29 12:00:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5b21a97e-a144-5cdd-a610-f712529497ca with scrape type 2
2026-03-29 12:00:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 5b21a97e-a144-5cdd-a610-f712529497ca, identifier: MW67597
2026-03-29 12:00:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 5b21a97e-a144-5cdd-a610-f712529497ca with identifier: MW67597
2026-03-29 12:00:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 5b21a97e-a144-5cdd-a610-f712529497ca with identifier: MW67597
2026-03-29 12:00:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 5b21a97e-a144-5cdd-a610-f712529497ca with identifier: MW67597 to the API
2026-03-29 12:00:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 12:00:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 12:00:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 165,
 'expiration_date': '2026-03-30T15:28:19Z',
 'fuel_type': 'petrol',
 'id': '5b21a97e-a144-5cdd-a610-f712529497ca',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MW67597',
 'listing': 'auction',
 'make': 'Alfa Romeo',
 'model': 'Alfa GT',
 'odometer': 200763,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2005-09-25',
 'seller_name': None,
 'title': 'Alfa Romeo Alfa GT 2.0 JTS Selesp Distinctive',
 'transmission': 'automatic',
 'trim': 'Selesp Distinctive',
 'year': 2005}
2026-03-29 12:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MW67597%27 HTTP/1.1" 200 None
2026-03-29 12:00:36 [auto1.nl] INFO: Saving data for MW67597: {'auction_closing_time': 1774884499.0, 'created_time': 1773947286.404418, 'last_price_update_time': 1774785636.862199}
2026-03-29 12:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='MW67597') HTTP/1.1" 204 0
2026-03-29 12:00:36 [auto1.nl] INFO: Found listing with ID: TC52581
2026-03-29 12:00:36 [auto1.nl] INFO: Found listing with ID: GC17693
2026-03-29 12:00:36 [auto1.nl] INFO: Found listing with ID: ME46694
2026-03-29 12:00:36 [auto1.nl] INFO: Found listing with ID: YD44164
2026-03-29 12:00:36 [auto1.nl] INFO: Found listing with ID: SS28591
2026-03-29 12:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:00:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SS28591%27 HTTP/1.1" 200 None
2026-03-29 12:00:36 [auto1.nl] INFO: Scrape type for SS28591: 2
2026-03-29 12:00:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e30b3009-d01f-55db-b151-5ede6a1956db with identifier: SS28591
2026-03-29 12:00:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e30b3009-d01f-55db-b151-5ede6a1956db with scrape type 2
2026-03-29 12:00:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e30b3009-d01f-55db-b151-5ede6a1956db with scrape type 2
2026-03-29 12:00:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: e30b3009-d01f-55db-b151-5ede6a1956db, identifier: SS28591
2026-03-29 12:00:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: e30b3009-d01f-55db-b151-5ede6a1956db with identifier: SS28591
2026-03-29 12:00:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 12:00:37 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=orange HTTP/1.1" 200 None
2026-03-29 12:00:37 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 12:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 12:00:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: e30b3009-d01f-55db-b151-5ede6a1956db with identifier: SS28591
2026-03-29 12:00:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: e30b3009-d01f-55db-b151-5ede6a1956db with identifier: SS28591 to the API
2026-03-29 12:00:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 12:00:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 12:00:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'orange',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 102,
 'expiration_date': '2026-03-30T15:24:35Z',
 'fuel_type': 'petrol',
 'id': 'e30b3009-d01f-55db-b151-5ede6a1956db',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SS28591',
 'listing': 'auction',
 'make': 'MINI',
 'model': 'MINI',
 'odometer': 87076,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-05-24',
 'seller_name': None,
 'title': 'MINI One',
 'transmission': 'manual',
 'trim': '',
 'year': 2018}
2026-03-29 12:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SS28591%27 HTTP/1.1" 200 None
2026-03-29 12:00:37 [auto1.nl] INFO: Saving data for SS28591: {'auction_closing_time': 1774884275.0, 'created_time': 1773229283.59128, 'last_price_update_time': 1774785637.555192}
2026-03-29 12:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='SS28591') HTTP/1.1" 204 0
2026-03-29 12:00:37 [auto1.nl] INFO: Channel: 24h | Page: 3 | totalHits: 759 | hits on page: 40
2026-03-29 12:00:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 759e4dce-919f-5300-b357-3718e28dbd6b with identifier: DW37625
2026-03-29 12:00:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 759e4dce-919f-5300-b357-3718e28dbd6b with scrape type 1
2026-03-29 12:00:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 759e4dce-919f-5300-b357-3718e28dbd6b
2026-03-29 12:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5e%252Fa3%252F5ea367f262b6895d77db390945a59db1%252Fpa%252FDW37625_1ed20248523b6b99f265346f2d29f31b.jpg%27 HTTP/1.1" 200 None
2026-03-29 12:00:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/a3/5ea367f262b6895d77db390945a59db1/pa/DW37625_1ed20248523b6b99f265346f2d29f31b.jpg already downloaded
2026-03-29 12:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5e%252Fa3%252F5ea367f262b6895d77db390945a59db1%252Fpa%252FDW37625_804d6f8a8e33478bea067d8020895974.jpg%27 HTTP/1.1" 200 None
2026-03-29 12:00:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/a3/5ea367f262b6895d77db390945a59db1/pa/DW37625_804d6f8a8e33478bea067d8020895974.jpg already downloaded
2026-03-29 12:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5e%252Fa3%252F5ea367f262b6895d77db390945a59db1%252Fpa%252FDW37625_17af83cc5ae3c5c97bad74e69482e3ba.jpg%27 HTTP/1.1" 200 None
2026-03-29 12:00:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/a3/5ea367f262b6895d77db390945a59db1/pa/DW37625_17af83cc5ae3c5c97bad74e69482e3ba.jpg already downloaded
2026-03-29 12:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5e%252Fa3%252F5ea367f262b6895d77db390945a59db1%252Fpa%252FDW37625_a52d64f0727d9ce8dc1beef0ae795ee4.jpg%27 HTTP/1.1" 200 None
2026-03-29 12:00:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/a3/5ea367f262b6895d77db390945a59db1/pa/DW37625_a52d64f0727d9ce8dc1beef0ae795ee4.jpg already downloaded
2026-03-29 12:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5e%252Fa3%252F5ea367f262b6895d77db390945a59db1%252Fpa%252FDW37625_fbb803ede81aaedbdfec0ea3325d1a6a.jpg%27 HTTP/1.1" 200 None
2026-03-29 12:00:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/a3/5ea367f262b6895d77db390945a59db1/pa/DW37625_fbb803ede81aaedbdfec0ea3325d1a6a.jpg already downloaded
2026-03-29 12:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5e%252Fa3%252F5ea367f262b6895d77db390945a59db1%252Fpa%252FDW37625_9287648ae06962e01ae531122e7e238b.jpg%27 HTTP/1.1" 200 None
2026-03-29 12:00:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/a3/5ea367f262b6895d77db390945a59db1/pa/DW37625_9287648ae06962e01ae531122e7e238b.jpg already downloaded
2026-03-29 12:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5e%252Fa3%252F5ea367f262b6895d77db390945a59db1%252Fpa%252FDW37625_09dae654e85f90c318d36d08b849ad98.jpg%27 HTTP/1.1" 200 None
2026-03-29 12:00:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/a3/5ea367f262b6895d77db390945a59db1/pa/DW37625_09dae654e85f90c318d36d08b849ad98.jpg already downloaded
2026-03-29 12:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5e%252Fa3%252F5ea367f262b6895d77db390945a59db1%252Fpa%252FDW37625_4e58b3f2c399aaaefbc35afa77bf7bc1.jpg%27 HTTP/1.1" 200 None
2026-03-29 12:00:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/a3/5ea367f262b6895d77db390945a59db1/pa/DW37625_4e58b3f2c399aaaefbc35afa77bf7bc1.jpg already downloaded
2026-03-29 12:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5e%252Fa3%252F5ea367f262b6895d77db390945a59db1%252Fpa%252FDW37625_e621dc6a26abec1548c60b6b0639be8e.jpg%27 HTTP/1.1" 200 None
2026-03-29 12:00:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/a3/5ea367f262b6895d77db390945a59db1/pa/DW37625_e621dc6a26abec1548c60b6b0639be8e.jpg already downloaded
2026-03-29 12:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg5e%252Fa3%252F5ea367f262b6895d77db390945a59db1%252Fpa%252FDW37625_1036bb768682115bba3f4bc405ad706e.jpg%27 HTTP/1.1" 200 None
2026-03-29 12:00:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img5e/a3/5ea367f262b6895d77db390945a59db1/pa/DW37625_1036bb768682115bba3f4bc405ad706e.jpg already downloaded
2026-03-29 12:00:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 759e4dce-919f-5300-b357-3718e28dbd6b, identifier: DW37625
2026-03-29 12:00:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2e6d9171-6b59-550e-aeeb-96d27288907e with identifier: NG83103
2026-03-29 12:00:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2e6d9171-6b59-550e-aeeb-96d27288907e with scrape type 1
2026-03-29 12:00:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 2e6d9171-6b59-550e-aeeb-96d27288907e
2026-03-29 12:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg71%252F8a%252F718af47de263cec0ad7b52779086af4b%252Fpa%252FNG83103_1438914db9e2a050a48db57880fc62dc.jpg%27 HTTP/1.1" 200 None
2026-03-29 12:00:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/8a/718af47de263cec0ad7b52779086af4b/pa/NG83103_1438914db9e2a050a48db57880fc62dc.jpg already downloaded
2026-03-29 12:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg71%252F8a%252F718af47de263cec0ad7b52779086af4b%252Fpa%252FNG83103_cf4e280718226f302ebefdf00da3782e.jpg%27 HTTP/1.1" 200 None
2026-03-29 12:00:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/8a/718af47de263cec0ad7b52779086af4b/pa/NG83103_cf4e280718226f302ebefdf00da3782e.jpg already downloaded
2026-03-29 12:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg71%252F8a%252F718af47de263cec0ad7b52779086af4b%252Fpa%252FNG83103_c80b17ef08c8c84a5f6e90ac257d1223.jpg%27 HTTP/1.1" 200 None
2026-03-29 12:00:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/8a/718af47de263cec0ad7b52779086af4b/pa/NG83103_c80b17ef08c8c84a5f6e90ac257d1223.jpg already downloaded
2026-03-29 12:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:00:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg71%252F8a%252F718af47de263cec0ad7b52779086af4b%252Fpa%252FNG83103_179c0a8c160aca3efdd6feb53fc193ab.jpg%27 HTTP/1.1" 200 None
2026-03-29 12:00:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/8a/718af47de263cec0ad7b52779086af4b/pa/NG83103_179c0a8c160aca3efdd6feb53fc193ab.jpg already downloaded
2026-03-29 12:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg71%252F8a%252F718af47de263cec0ad7b52779086af4b%252Fpa%252FNG83103_c3300e1f7de7786afb7e664e6ff1d2ff.jpg%27 HTTP/1.1" 200 None
2026-03-29 12:00:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/8a/718af47de263cec0ad7b52779086af4b/pa/NG83103_c3300e1f7de7786afb7e664e6ff1d2ff.jpg already downloaded
2026-03-29 12:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg71%252F8a%252F718af47de263cec0ad7b52779086af4b%252Fpa%252FNG83103_751f6e9f445ec332068347bc5aba28a0.jpg%27 HTTP/1.1" 200 None
2026-03-29 12:00:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/8a/718af47de263cec0ad7b52779086af4b/pa/NG83103_751f6e9f445ec332068347bc5aba28a0.jpg already downloaded
2026-03-29 12:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg71%252F8a%252F718af47de263cec0ad7b52779086af4b%252Fpa%252FNG83103_4224a0eef823a38f6c1c2530d6f59999.jpg%27 HTTP/1.1" 200 None
2026-03-29 12:00:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/8a/718af47de263cec0ad7b52779086af4b/pa/NG83103_4224a0eef823a38f6c1c2530d6f59999.jpg already downloaded
2026-03-29 12:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg71%252F8a%252F718af47de263cec0ad7b52779086af4b%252Fpa%252FNG83103_7c05d85730cd797e8c9efd355f957f10.jpg%27 HTTP/1.1" 200 None
2026-03-29 12:00:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/8a/718af47de263cec0ad7b52779086af4b/pa/NG83103_7c05d85730cd797e8c9efd355f957f10.jpg already downloaded
2026-03-29 12:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg71%252F8a%252F718af47de263cec0ad7b52779086af4b%252Fpa%252FNG83103_0c730d8d05f1b053f35ace446abe8427.jpg%27 HTTP/1.1" 200 None
2026-03-29 12:00:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/8a/718af47de263cec0ad7b52779086af4b/pa/NG83103_0c730d8d05f1b053f35ace446abe8427.jpg already downloaded
2026-03-29 12:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg71%252F8a%252F718af47de263cec0ad7b52779086af4b%252Fpa%252FNG83103_4fb33926ba9469ea618b421128efe2a5.jpg%27 HTTP/1.1" 200 None
2026-03-29 12:00:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img71/8a/718af47de263cec0ad7b52779086af4b/pa/NG83103_4fb33926ba9469ea618b421128efe2a5.jpg already downloaded
2026-03-29 12:00:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 2e6d9171-6b59-550e-aeeb-96d27288907e, identifier: NG83103
2026-03-29 12:00:38 [auto1.nl] INFO: Found listing with ID: DJ12615
2026-03-29 12:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DJ12615%27 HTTP/1.1" 200 None
2026-03-29 12:00:38 [auto1.nl] INFO: Scrape type for DJ12615: 1
2026-03-29 12:00:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 759e4dce-919f-5300-b357-3718e28dbd6b with identifier: DW37625
2026-03-29 12:00:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 759e4dce-919f-5300-b357-3718e28dbd6b with identifier: DW37625
2026-03-29 12:00:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 759e4dce-919f-5300-b357-3718e28dbd6b with identifier: DW37625 to the API
2026-03-29 12:00:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 12:00:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 12:00:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/DW37625>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.4L',
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:07:03Z',
 'fuel_type': 'petrol',
 'id': '759e4dce-919f-5300-b357-3718e28dbd6b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'Xk399f',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DW37625',
 'listing': 'auction',
 'location': 'NL, Oosterhout',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 131053,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img5e/a3/5ea367f262b6895d77db390945a59db1/pa/DW37625_1ed20248523b6b99f265346f2d29f31b.jpg',
                'https://img-pa.auto1.com/img5e/a3/5ea367f262b6895d77db390945a59db1/pa/DW37625_804d6f8a8e33478bea067d8020895974.jpg',
                'https://img-pa.auto1.com/img5e/a3/5ea367f262b6895d77db390945a59db1/pa/DW37625_17af83cc5ae3c5c97bad74e69482e3ba.jpg',
                'https://img-pa.auto1.com/img5e/a3/5ea367f262b6895d77db390945a59db1/pa/DW37625_a52d64f0727d9ce8dc1beef0ae795ee4.jpg',
                'https://img-pa.auto1.com/img5e/a3/5ea367f262b6895d77db390945a59db1/pa/DW37625_fbb803ede81aaedbdfec0ea3325d1a6a.jpg',
                'https://img-pa.auto1.com/img5e/a3/5ea367f262b6895d77db390945a59db1/pa/DW37625_9287648ae06962e01ae531122e7e238b.jpg',
                'https://img-pa.auto1.com/img5e/a3/5ea367f262b6895d77db390945a59db1/pa/DW37625_09dae654e85f90c318d36d08b849ad98.jpg',
                'https://img-pa.auto1.com/img5e/a3/5ea367f262b6895d77db390945a59db1/pa/DW37625_4e58b3f2c399aaaefbc35afa77bf7bc1.jpg',
                'https://img-pa.auto1.com/img5e/a3/5ea367f262b6895d77db390945a59db1/pa/DW37625_e621dc6a26abec1548c60b6b0639be8e.jpg',
                'https://img-pa.auto1.com/img5e/a3/5ea367f262b6895d77db390945a59db1/pa/DW37625_1036bb768682115bba3f4bc405ad706e.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_759e4dce-919f-5300-b357-3718e28dbd6b/759e4dce-919f-5300-b357-3718e28dbd6b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66183,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5e/a3/5ea367f262b6895d77db390945a59db1/pa/DW37625_1ed20248523b6b99f265346f2d29f31b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_759e4dce-919f-5300-b357-3718e28dbd6b/759e4dce-919f-5300-b357-3718e28dbd6b_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67161,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5e/a3/5ea367f262b6895d77db390945a59db1/pa/DW37625_804d6f8a8e33478bea067d8020895974.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_759e4dce-919f-5300-b357-3718e28dbd6b/759e4dce-919f-5300-b357-3718e28dbd6b_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65691,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5e/a3/5ea367f262b6895d77db390945a59db1/pa/DW37625_17af83cc5ae3c5c97bad74e69482e3ba.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_759e4dce-919f-5300-b357-3718e28dbd6b/759e4dce-919f-5300-b357-3718e28dbd6b_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54446,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5e/a3/5ea367f262b6895d77db390945a59db1/pa/DW37625_a52d64f0727d9ce8dc1beef0ae795ee4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_759e4dce-919f-5300-b357-3718e28dbd6b/759e4dce-919f-5300-b357-3718e28dbd6b_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55219,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5e/a3/5ea367f262b6895d77db390945a59db1/pa/DW37625_fbb803ede81aaedbdfec0ea3325d1a6a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_759e4dce-919f-5300-b357-3718e28dbd6b/759e4dce-919f-5300-b357-3718e28dbd6b_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70442,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5e/a3/5ea367f262b6895d77db390945a59db1/pa/DW37625_9287648ae06962e01ae531122e7e238b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_759e4dce-919f-5300-b357-3718e28dbd6b/759e4dce-919f-5300-b357-3718e28dbd6b_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53920,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5e/a3/5ea367f262b6895d77db390945a59db1/pa/DW37625_09dae654e85f90c318d36d08b849ad98.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_759e4dce-919f-5300-b357-3718e28dbd6b/759e4dce-919f-5300-b357-3718e28dbd6b_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73082,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5e/a3/5ea367f262b6895d77db390945a59db1/pa/DW37625_4e58b3f2c399aaaefbc35afa77bf7bc1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_759e4dce-919f-5300-b357-3718e28dbd6b/759e4dce-919f-5300-b357-3718e28dbd6b_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64537,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5e/a3/5ea367f262b6895d77db390945a59db1/pa/DW37625_e621dc6a26abec1548c60b6b0639be8e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_759e4dce-919f-5300-b357-3718e28dbd6b/759e4dce-919f-5300-b357-3718e28dbd6b_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 36356,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img5e/a3/5ea367f262b6895d77db390945a59db1/pa/DW37625_1036bb768682115bba3f4bc405ad706e.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2013-03-05',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Golf VII 1.4 TSI ACT Highline BlueMotion Tech',
 'transmission': 'automatic',
 'trim': 'Highline BlueMotion Tech',
 'year': 2013}
2026-03-29 12:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DW37625%27 HTTP/1.1" 200 None
2026-03-29 12:00:38 [auto1.nl] INFO: Saving data for DW37625: {'created_time': 1774785638.5506, 'last_price_update_time': 1774785638.550612, 'auction_closing_time': 1774883223.0}
2026-03-29 12:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='DW37625') HTTP/1.1" 204 0
2026-03-29 12:00:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 2e6d9171-6b59-550e-aeeb-96d27288907e with identifier: NG83103
2026-03-29 12:00:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 2e6d9171-6b59-550e-aeeb-96d27288907e with identifier: NG83103
2026-03-29 12:00:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 2e6d9171-6b59-550e-aeeb-96d27288907e with identifier: NG83103 to the API
2026-03-29 12:00:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 12:00:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 12:00:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/NG83103>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'engine_horse_power': 122,
 'expiration_date': '2026-03-30T15:49:48Z',
 'fuel_type': 'petrol',
 'id': '2e6d9171-6b59-550e-aeeb-96d27288907e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'SL674K',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NG83103',
 'listing': 'auction',
 'location': 'NL, Oosterhout',
 'make': 'Mercedes-Benz',
 'model': 'A-Klasse',
 'odometer': 82399,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img71/8a/718af47de263cec0ad7b52779086af4b/pa/NG83103_1438914db9e2a050a48db57880fc62dc.jpg',
                'https://img-pa.auto1.com/img71/8a/718af47de263cec0ad7b52779086af4b/pa/NG83103_cf4e280718226f302ebefdf00da3782e.jpg',
                'https://img-pa.auto1.com/img71/8a/718af47de263cec0ad7b52779086af4b/pa/NG83103_c80b17ef08c8c84a5f6e90ac257d1223.jpg',
                'https://img-pa.auto1.com/img71/8a/718af47de263cec0ad7b52779086af4b/pa/NG83103_179c0a8c160aca3efdd6feb53fc193ab.jpg',
                'https://img-pa.auto1.com/img71/8a/718af47de263cec0ad7b52779086af4b/pa/NG83103_c3300e1f7de7786afb7e664e6ff1d2ff.jpg',
                'https://img-pa.auto1.com/img71/8a/718af47de263cec0ad7b52779086af4b/pa/NG83103_751f6e9f445ec332068347bc5aba28a0.jpg',
                'https://img-pa.auto1.com/img71/8a/718af47de263cec0ad7b52779086af4b/pa/NG83103_4224a0eef823a38f6c1c2530d6f59999.jpg',
                'https://img-pa.auto1.com/img71/8a/718af47de263cec0ad7b52779086af4b/pa/NG83103_7c05d85730cd797e8c9efd355f957f10.jpg',
                'https://img-pa.auto1.com/img71/8a/718af47de263cec0ad7b52779086af4b/pa/NG83103_0c730d8d05f1b053f35ace446abe8427.jpg',
                'https://img-pa.auto1.com/img71/8a/718af47de263cec0ad7b52779086af4b/pa/NG83103_4fb33926ba9469ea618b421128efe2a5.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2e6d9171-6b59-550e-aeeb-96d27288907e/2e6d9171-6b59-550e-aeeb-96d27288907e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74304,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img71/8a/718af47de263cec0ad7b52779086af4b/pa/NG83103_1438914db9e2a050a48db57880fc62dc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2e6d9171-6b59-550e-aeeb-96d27288907e/2e6d9171-6b59-550e-aeeb-96d27288907e_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81017,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img71/8a/718af47de263cec0ad7b52779086af4b/pa/NG83103_cf4e280718226f302ebefdf00da3782e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2e6d9171-6b59-550e-aeeb-96d27288907e/2e6d9171-6b59-550e-aeeb-96d27288907e_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66340,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img71/8a/718af47de263cec0ad7b52779086af4b/pa/NG83103_c80b17ef08c8c84a5f6e90ac257d1223.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2e6d9171-6b59-550e-aeeb-96d27288907e/2e6d9171-6b59-550e-aeeb-96d27288907e_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66216,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img71/8a/718af47de263cec0ad7b52779086af4b/pa/NG83103_179c0a8c160aca3efdd6feb53fc193ab.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2e6d9171-6b59-550e-aeeb-96d27288907e/2e6d9171-6b59-550e-aeeb-96d27288907e_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58350,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img71/8a/718af47de263cec0ad7b52779086af4b/pa/NG83103_c3300e1f7de7786afb7e664e6ff1d2ff.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2e6d9171-6b59-550e-aeeb-96d27288907e/2e6d9171-6b59-550e-aeeb-96d27288907e_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67650,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img71/8a/718af47de263cec0ad7b52779086af4b/pa/NG83103_751f6e9f445ec332068347bc5aba28a0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2e6d9171-6b59-550e-aeeb-96d27288907e/2e6d9171-6b59-550e-aeeb-96d27288907e_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68398,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img71/8a/718af47de263cec0ad7b52779086af4b/pa/NG83103_4224a0eef823a38f6c1c2530d6f59999.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2e6d9171-6b59-550e-aeeb-96d27288907e/2e6d9171-6b59-550e-aeeb-96d27288907e_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72501,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img71/8a/718af47de263cec0ad7b52779086af4b/pa/NG83103_7c05d85730cd797e8c9efd355f957f10.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2e6d9171-6b59-550e-aeeb-96d27288907e/2e6d9171-6b59-550e-aeeb-96d27288907e_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66192,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img71/8a/718af47de263cec0ad7b52779086af4b/pa/NG83103_0c730d8d05f1b053f35ace446abe8427.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2e6d9171-6b59-550e-aeeb-96d27288907e/2e6d9171-6b59-550e-aeeb-96d27288907e_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61333,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img71/8a/718af47de263cec0ad7b52779086af4b/pa/NG83103_4fb33926ba9469ea618b421128efe2a5.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-03-31',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz A-Klasse A 180 BlueEfficiency Style',
 'transmission': 'automatic',
 'trim': 'BlueEfficiency Style',
 'year': 2018}
2026-03-29 12:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NG83103%27 HTTP/1.1" 200 None
2026-03-29 12:00:38 [auto1.nl] INFO: Saving data for NG83103: {'created_time': 1774785638.901458, 'last_price_update_time': 1774785638.901469, 'auction_closing_time': 1774885788.0}
2026-03-29 12:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='NG83103') HTTP/1.1" 204 0
2026-03-29 12:00:38 [auto1.nl] INFO: Found listing with ID: SS31744
2026-03-29 12:00:38 [auto1.nl] INFO: Found listing with ID: PS47079
2026-03-29 12:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:00:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PS47079%27 HTTP/1.1" 200 None
2026-03-29 12:00:38 [auto1.nl] INFO: Scrape type for PS47079: 2
2026-03-29 12:00:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2ab25f80-8742-5d7e-918f-5200d27da916 with identifier: PS47079
2026-03-29 12:00:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2ab25f80-8742-5d7e-918f-5200d27da916 with scrape type 2
2026-03-29 12:00:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2ab25f80-8742-5d7e-918f-5200d27da916 with scrape type 2
2026-03-29 12:00:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 2ab25f80-8742-5d7e-918f-5200d27da916, identifier: PS47079
2026-03-29 12:00:39 [auto1.nl] INFO: Found listing with ID: EX76007
2026-03-29 12:00:39 [auto1.nl] INFO: Found listing with ID: FS78045
2026-03-29 12:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FS78045%27 HTTP/1.1" 200 None
2026-03-29 12:00:39 [auto1.nl] INFO: Scrape type for FS78045: 2
2026-03-29 12:00:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5c1ebcc3-879e-524d-9223-a5c8cab7698a with identifier: FS78045
2026-03-29 12:00:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5c1ebcc3-879e-524d-9223-a5c8cab7698a with scrape type 2
2026-03-29 12:00:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5c1ebcc3-879e-524d-9223-a5c8cab7698a with scrape type 2
2026-03-29 12:00:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 5c1ebcc3-879e-524d-9223-a5c8cab7698a, identifier: FS78045
2026-03-29 12:00:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 2ab25f80-8742-5d7e-918f-5200d27da916 with identifier: PS47079
2026-03-29 12:00:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 2ab25f80-8742-5d7e-918f-5200d27da916 with identifier: PS47079
2026-03-29 12:00:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 2ab25f80-8742-5d7e-918f-5200d27da916 with identifier: PS47079 to the API
2026-03-29 12:00:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 12:00:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 12:00:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:11:03Z',
 'fuel_type': 'petrol',
 'id': '2ab25f80-8742-5d7e-918f-5200d27da916',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PS47079',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q3',
 'odometer': 60905,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-07-15',
 'seller_name': None,
 'title': 'Audi Q3 40 TFSI quattro S Line',
 'transmission': 'automatic',
 'trim': 'quattro S Line',
 'year': 2019}
2026-03-29 12:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PS47079%27 HTTP/1.1" 200 None
2026-03-29 12:00:39 [auto1.nl] INFO: Saving data for PS47079: {'auction_closing_time': 1774883463.0, 'created_time': 1773132167.488665, 'last_price_update_time': 1774785639.448166}
2026-03-29 12:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='PS47079') HTTP/1.1" 204 0
2026-03-29 12:00:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZE22789/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 12:00:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 12:00:39 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 12:00:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 5c1ebcc3-879e-524d-9223-a5c8cab7698a with identifier: FS78045
2026-03-29 12:00:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 5c1ebcc3-879e-524d-9223-a5c8cab7698a with identifier: FS78045
2026-03-29 12:00:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 5c1ebcc3-879e-524d-9223-a5c8cab7698a with identifier: FS78045 to the API
2026-03-29 12:00:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 12:00:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 12:00:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 73,
 'expiration_date': '2026-03-30T15:37:43Z',
 'fuel_type': 'petrol',
 'id': '5c1ebcc3-879e-524d-9223-a5c8cab7698a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FS78045',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C3',
 'odometer': 170640,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2005-08-24',
 'seller_name': None,
 'title': 'Citroen C3 1.4 Style',
 'transmission': 'manual',
 'trim': 'Style',
 'year': 2005}
2026-03-29 12:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FS78045%27 HTTP/1.1" 200 None
2026-03-29 12:00:39 [auto1.nl] INFO: Saving data for FS78045: {'auction_closing_time': 1774885063.0, 'created_time': 1774551743.715782, 'last_price_update_time': 1774785639.796285}
2026-03-29 12:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='FS78045') HTTP/1.1" 204 0
2026-03-29 12:00:39 [auto1.nl] INFO: Found listing with ID: EV31817
2026-03-29 12:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EV31817%27 HTTP/1.1" 200 None
2026-03-29 12:00:39 [auto1.nl] INFO: Scrape type for EV31817: 2
2026-03-29 12:00:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 44ca85c7-2f30-580e-8d80-660f41395d99 with identifier: EV31817
2026-03-29 12:00:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 44ca85c7-2f30-580e-8d80-660f41395d99 with scrape type 2
2026-03-29 12:00:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 44ca85c7-2f30-580e-8d80-660f41395d99 with scrape type 2
2026-03-29 12:00:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 44ca85c7-2f30-580e-8d80-660f41395d99, identifier: EV31817
2026-03-29 12:00:39 [auto1.nl] INFO: Found listing with ID: FF33290
2026-03-29 12:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:00:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FF33290%27 HTTP/1.1" 200 None
2026-03-29 12:00:39 [auto1.nl] INFO: Scrape type for FF33290: 1
2026-03-29 12:00:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 44ca85c7-2f30-580e-8d80-660f41395d99 with identifier: EV31817
2026-03-29 12:00:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 44ca85c7-2f30-580e-8d80-660f41395d99 with identifier: EV31817
2026-03-29 12:00:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 44ca85c7-2f30-580e-8d80-660f41395d99 with identifier: EV31817 to the API
2026-03-29 12:00:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 12:00:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 12:00:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 159,
 'expiration_date': '2026-03-30T15:13:37Z',
 'fuel_type': 'petrol',
 'id': '44ca85c7-2f30-580e-8d80-660f41395d99',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EV31817',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'X-Trail',
 'odometer': 38854,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-05-28',
 'seller_name': None,
 'title': 'Nissan X-Trail 1.3 DIG-T N-Tec',
 'transmission': 'automatic',
 'trim': 'N-Tec',
 'year': 2020}
2026-03-29 12:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EV31817%27 HTTP/1.1" 200 None
2026-03-29 12:00:40 [auto1.nl] INFO: Saving data for EV31817: {'auction_closing_time': 1774883617.0, 'created_time': 1774551698.818204, 'last_price_update_time': 1774785640.249667}
2026-03-29 12:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='EV31817') HTTP/1.1" 204 0
2026-03-29 12:00:40 [auto1.nl] INFO: Found listing with ID: GY89787
2026-03-29 12:00:40 [auto1.nl] INFO: Found listing with ID: VL52985
2026-03-29 12:00:40 [auto1.nl] INFO: Found listing with ID: CA77037
2026-03-29 12:00:40 [auto1.nl] INFO: Found listing with ID: MC51093
2026-03-29 12:00:40 [auto1.nl] INFO: Found listing with ID: KH55431
2026-03-29 12:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KH55431%27 HTTP/1.1" 200 None
2026-03-29 12:00:40 [auto1.nl] INFO: Scrape type for KH55431: 1
2026-03-29 12:00:40 [auto1.nl] INFO: Found listing with ID: MB43165
2026-03-29 12:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MB43165%27 HTTP/1.1" 200 None
2026-03-29 12:00:40 [auto1.nl] INFO: Scrape type for MB43165: 1
2026-03-29 12:00:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 12:00:40 [auto1.nl] INFO: Found listing with ID: ZL38920
2026-03-29 12:00:40 [auto1.nl] INFO: Found listing with ID: UE74675
2026-03-29 12:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UE74675%27 HTTP/1.1" 200 None
2026-03-29 12:00:40 [auto1.nl] INFO: Scrape type for UE74675: 2
2026-03-29 12:00:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 68b6c843-8a8a-563b-874e-9f9237552b00 with identifier: UE74675
2026-03-29 12:00:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 68b6c843-8a8a-563b-874e-9f9237552b00 with scrape type 2
2026-03-29 12:00:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 68b6c843-8a8a-563b-874e-9f9237552b00 with scrape type 2
2026-03-29 12:00:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 68b6c843-8a8a-563b-874e-9f9237552b00, identifier: UE74675
2026-03-29 12:00:40 [auto1.nl] INFO: Found listing with ID: DK68166
2026-03-29 12:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DK68166%27 HTTP/1.1" 200 None
2026-03-29 12:00:40 [auto1.nl] INFO: Scrape type for DK68166: 2
2026-03-29 12:00:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 748e1a04-c277-5e88-916c-ee3ada95371b with identifier: DK68166
2026-03-29 12:00:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 748e1a04-c277-5e88-916c-ee3ada95371b with scrape type 2
2026-03-29 12:00:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 748e1a04-c277-5e88-916c-ee3ada95371b with scrape type 2
2026-03-29 12:00:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 748e1a04-c277-5e88-916c-ee3ada95371b, identifier: DK68166
2026-03-29 12:00:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 68b6c843-8a8a-563b-874e-9f9237552b00 with identifier: UE74675
2026-03-29 12:00:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 68b6c843-8a8a-563b-874e-9f9237552b00 with identifier: UE74675
2026-03-29 12:00:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 68b6c843-8a8a-563b-874e-9f9237552b00 with identifier: UE74675 to the API
2026-03-29 12:00:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 12:00:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 12:00:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 163,
 'expiration_date': '2026-03-30T15:00:28Z',
 'fuel_type': 'petrol',
 'id': '68b6c843-8a8a-563b-874e-9f9237552b00',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UE74675',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Kadjar',
 'odometer': 120637,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-01-30',
 'seller_name': None,
 'title': 'Renault Kadjar 1.6 TCe Energy Bose Edition',
 'transmission': 'manual',
 'trim': 'Bose Edition',
 'year': 2018}
2026-03-29 12:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UE74675%27 HTTP/1.1" 200 None
2026-03-29 12:00:40 [auto1.nl] INFO: Saving data for UE74675: {'auction_closing_time': 1774882828.0, 'created_time': 1773837103.385773, 'last_price_update_time': 1774785640.955289}
2026-03-29 12:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:00:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='UE74675') HTTP/1.1" 204 0
2026-03-29 12:00:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 12:00:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 12:00:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 12:00:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 748e1a04-c277-5e88-916c-ee3ada95371b with identifier: DK68166
2026-03-29 12:00:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 748e1a04-c277-5e88-916c-ee3ada95371b with identifier: DK68166
2026-03-29 12:00:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 748e1a04-c277-5e88-916c-ee3ada95371b with identifier: DK68166 to the API
2026-03-29 12:00:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 12:00:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 12:00:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 580,
 'expiration_date': '2026-03-30T15:54:25Z',
 'fuel_type': 'petrol',
 'id': '748e1a04-c277-5e88-916c-ee3ada95371b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DK68166',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'RS 6',
 'odometer': 154964,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-12-31',
 'seller_name': None,
 'title': 'Audi RS 6 5.0 V10 FSI quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2008}
2026-03-29 12:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DK68166%27 HTTP/1.1" 200 None
2026-03-29 12:00:41 [auto1.nl] INFO: Saving data for DK68166: {'auction_closing_time': 1774886065.0, 'created_time': 1773343674.566893, 'last_price_update_time': 1774785641.280199}
2026-03-29 12:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='DK68166') HTTP/1.1" 204 0
2026-03-29 12:00:41 [auto1.nl] INFO: Found listing with ID: EG10969
2026-03-29 12:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EG10969%27 HTTP/1.1" 200 None
2026-03-29 12:00:41 [auto1.nl] INFO: Scrape type for EG10969: 2
2026-03-29 12:00:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9d407ea1-43b5-510e-8d5f-6a931dbda60e with identifier: EG10969
2026-03-29 12:00:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9d407ea1-43b5-510e-8d5f-6a931dbda60e with scrape type 2
2026-03-29 12:00:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9d407ea1-43b5-510e-8d5f-6a931dbda60e with scrape type 2
2026-03-29 12:00:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 9d407ea1-43b5-510e-8d5f-6a931dbda60e, identifier: EG10969
2026-03-29 12:00:41 [auto1.nl] INFO: Found listing with ID: WM74497
2026-03-29 12:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WM74497%27 HTTP/1.1" 200 None
2026-03-29 12:00:41 [auto1.nl] INFO: Scrape type for WM74497: 2
2026-03-29 12:00:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 359ff304-cdd4-57cd-a4cb-38c0cbf8dae0 with identifier: WM74497
2026-03-29 12:00:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 359ff304-cdd4-57cd-a4cb-38c0cbf8dae0 with scrape type 2
2026-03-29 12:00:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 359ff304-cdd4-57cd-a4cb-38c0cbf8dae0 with scrape type 2
2026-03-29 12:00:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 359ff304-cdd4-57cd-a4cb-38c0cbf8dae0, identifier: WM74497
2026-03-29 12:00:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 9d407ea1-43b5-510e-8d5f-6a931dbda60e with identifier: EG10969
2026-03-29 12:00:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 12:00:41 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=diesel HTTP/1.1" 200 None
2026-03-29 12:00:41 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 12:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 12:00:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 9d407ea1-43b5-510e-8d5f-6a931dbda60e with identifier: EG10969
2026-03-29 12:00:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 9d407ea1-43b5-510e-8d5f-6a931dbda60e with identifier: EG10969 to the API
2026-03-29 12:00:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 12:00:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 12:00:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-30T15:24:56Z',
 'fuel_type': 'diesel',
 'id': '9d407ea1-43b5-510e-8d5f-6a931dbda60e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EG10969',
 'listing': 'auction',
 'make': 'BMW',
 'model': '5er',
 'odometer': 164019,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-01-27',
 'seller_name': None,
 'title': 'BMW 5er 520d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2011}
2026-03-29 12:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:00:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EG10969%27 HTTP/1.1" 200 None
2026-03-29 12:00:41 [auto1.nl] INFO: Saving data for EG10969: {'auction_closing_time': 1774884296.0, 'created_time': 1773134962.472984, 'last_price_update_time': 1774785641.996718}
2026-03-29 12:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='EG10969') HTTP/1.1" 204 0
2026-03-29 12:00:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 359ff304-cdd4-57cd-a4cb-38c0cbf8dae0 with identifier: WM74497
2026-03-29 12:00:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 359ff304-cdd4-57cd-a4cb-38c0cbf8dae0 with identifier: WM74497
2026-03-29 12:00:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 359ff304-cdd4-57cd-a4cb-38c0cbf8dae0 with identifier: WM74497 to the API
2026-03-29 12:00:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 12:00:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 12:00:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 80,
 'expiration_date': '2026-03-30T15:47:50Z',
 'fuel_type': 'petrol',
 'id': '359ff304-cdd4-57cd-a4cb-38c0cbf8dae0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WM74497',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Corsa',
 'odometer': 159061,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-07-16',
 'seller_name': None,
 'title': 'Opel Corsa 1.2 Edition',
 'transmission': 'manual',
 'trim': 'Edition',
 'year': 2007}
2026-03-29 12:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WM74497%27 HTTP/1.1" 200 None
2026-03-29 12:00:42 [auto1.nl] INFO: Saving data for WM74497: {'auction_closing_time': 1774885670.0, 'created_time': 1773861222.657318, 'last_price_update_time': 1774785642.40973}
2026-03-29 12:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='WM74497') HTTP/1.1" 204 0
2026-03-29 12:00:42 [auto1.nl] INFO: Found listing with ID: RC67109
2026-03-29 12:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RC67109%27 HTTP/1.1" 200 None
2026-03-29 12:00:42 [auto1.nl] INFO: Scrape type for RC67109: 2
2026-03-29 12:00:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 02046a39-e875-5c34-a465-c0d2f2d80f26 with identifier: RC67109
2026-03-29 12:00:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 02046a39-e875-5c34-a465-c0d2f2d80f26 with scrape type 2
2026-03-29 12:00:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 02046a39-e875-5c34-a465-c0d2f2d80f26 with scrape type 2
2026-03-29 12:00:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 02046a39-e875-5c34-a465-c0d2f2d80f26, identifier: RC67109
2026-03-29 12:00:42 [auto1.nl] INFO: Found listing with ID: SU37312
2026-03-29 12:00:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 02046a39-e875-5c34-a465-c0d2f2d80f26 with identifier: RC67109
2026-03-29 12:00:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 02046a39-e875-5c34-a465-c0d2f2d80f26 with identifier: RC67109
2026-03-29 12:00:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 02046a39-e875-5c34-a465-c0d2f2d80f26 with identifier: RC67109 to the API
2026-03-29 12:00:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 12:00:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 12:00:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 215,
 'expiration_date': '2026-03-30T15:11:51Z',
 'fuel_type': 'diesel',
 'id': '02046a39-e875-5c34-a465-c0d2f2d80f26',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RC67109',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'XC60',
 'odometer': 182468,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-08-06',
 'seller_name': None,
 'title': 'Volvo XC60 2.4 D5 R-Design AWD',
 'transmission': 'automatic',
 'trim': 'R-Design AWD',
 'year': 2012}
2026-03-29 12:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RC67109%27 HTTP/1.1" 200 None
2026-03-29 12:00:42 [auto1.nl] INFO: Saving data for RC67109: {'auction_closing_time': 1774883511.0, 'created_time': 1773232228.801859, 'last_price_update_time': 1774785642.843134}
2026-03-29 12:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='RC67109') HTTP/1.1" 204 0
2026-03-29 12:00:42 [auto1.nl] INFO: Found listing with ID: KE96226
2026-03-29 12:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:00:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KE96226%27 HTTP/1.1" 200 None
2026-03-29 12:00:42 [auto1.nl] INFO: Scrape type for KE96226: 2
2026-03-29 12:00:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3fd33182-086a-5be8-9fcb-059e046c140a with identifier: KE96226
2026-03-29 12:00:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3fd33182-086a-5be8-9fcb-059e046c140a with scrape type 2
2026-03-29 12:00:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3fd33182-086a-5be8-9fcb-059e046c140a with scrape type 2
2026-03-29 12:00:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 3fd33182-086a-5be8-9fcb-059e046c140a, identifier: KE96226
2026-03-29 12:00:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 3fd33182-086a-5be8-9fcb-059e046c140a with identifier: KE96226
2026-03-29 12:00:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 3fd33182-086a-5be8-9fcb-059e046c140a with identifier: KE96226
2026-03-29 12:00:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 3fd33182-086a-5be8-9fcb-059e046c140a with identifier: KE96226 to the API
2026-03-29 12:00:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 12:00:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 12:00:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 85,
 'expiration_date': '2026-03-30T15:52:25Z',
 'fuel_type': 'diesel',
 'id': '3fd33182-086a-5be8-9fcb-059e046c140a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KE96226',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Twingo',
 'odometer': 217210,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-04-12',
 'seller_name': None,
 'title': 'Renault Twingo 1.5 dCi Dynamique',
 'transmission': 'manual',
 'trim': 'Dynamique',
 'year': 2011}
2026-03-29 12:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KE96226%27 HTTP/1.1" 200 None
2026-03-29 12:00:43 [auto1.nl] INFO: Saving data for KE96226: {'auction_closing_time': 1774885945.0, 'created_time': 1773131834.172676, 'last_price_update_time': 1774785643.249893}
2026-03-29 12:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='KE96226') HTTP/1.1" 204 0
2026-03-29 12:00:43 [auto1.nl] INFO: Found listing with ID: SZ31943
2026-03-29 12:00:43 [auto1.nl] INFO: Found listing with ID: VW61331
2026-03-29 12:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VW61331%27 HTTP/1.1" 200 None
2026-03-29 12:00:43 [auto1.nl] INFO: Scrape type for VW61331: 2
2026-03-29 12:00:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 755b2e8d-43e1-5256-972d-0ee351e173ea with identifier: VW61331
2026-03-29 12:00:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 755b2e8d-43e1-5256-972d-0ee351e173ea with scrape type 2
2026-03-29 12:00:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 755b2e8d-43e1-5256-972d-0ee351e173ea with scrape type 2
2026-03-29 12:00:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 755b2e8d-43e1-5256-972d-0ee351e173ea, identifier: VW61331
2026-03-29 12:00:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/XU83484/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 12:00:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 755b2e8d-43e1-5256-972d-0ee351e173ea with identifier: VW61331
2026-03-29 12:00:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 755b2e8d-43e1-5256-972d-0ee351e173ea with identifier: VW61331
2026-03-29 12:00:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 755b2e8d-43e1-5256-972d-0ee351e173ea with identifier: VW61331 to the API
2026-03-29 12:00:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 12:00:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 12:00:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-30T15:32:05Z',
 'fuel_type': 'petrol',
 'id': '755b2e8d-43e1-5256-972d-0ee351e173ea',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VW61331',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'Yaris',
 'odometer': 301671,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-04-15',
 'seller_name': None,
 'title': 'Toyota Yaris 1.0 VVT-i Active',
 'transmission': 'manual',
 'trim': 'Active',
 'year': 2011}
2026-03-29 12:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VW61331%27 HTTP/1.1" 200 None
2026-03-29 12:00:43 [auto1.nl] INFO: Saving data for VW61331: {'auction_closing_time': 1774884725.0, 'created_time': 1773232264.907713, 'last_price_update_time': 1774785643.680278}
2026-03-29 12:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='VW61331') HTTP/1.1" 204 0
2026-03-29 12:00:43 [auto1.nl] INFO: Found listing with ID: TU57635
2026-03-29 12:00:43 [auto1.nl] INFO: Found listing with ID: DF82688
2026-03-29 12:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:00:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DF82688%27 HTTP/1.1" 200 None
2026-03-29 12:00:43 [auto1.nl] INFO: Scrape type for DF82688: 2
2026-03-29 12:00:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4d9c2f77-39b7-50fc-bc99-611b6d28b7a3 with identifier: DF82688
2026-03-29 12:00:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4d9c2f77-39b7-50fc-bc99-611b6d28b7a3 with scrape type 2
2026-03-29 12:00:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4d9c2f77-39b7-50fc-bc99-611b6d28b7a3 with scrape type 2
2026-03-29 12:00:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 4d9c2f77-39b7-50fc-bc99-611b6d28b7a3, identifier: DF82688
2026-03-29 12:00:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DJ12615/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 12:00:43 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 12:00:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 4d9c2f77-39b7-50fc-bc99-611b6d28b7a3 with identifier: DF82688
2026-03-29 12:00:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 4d9c2f77-39b7-50fc-bc99-611b6d28b7a3 with identifier: DF82688
2026-03-29 12:00:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 4d9c2f77-39b7-50fc-bc99-611b6d28b7a3 with identifier: DF82688 to the API
2026-03-29 12:00:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 12:00:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 12:00:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-30T15:14:15Z',
 'fuel_type': 'petrol',
 'id': '4d9c2f77-39b7-50fc-bc99-611b6d28b7a3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DF82688',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII Sportsvan',
 'odometer': 51601,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-03-25',
 'seller_name': None,
 'title': 'Volkswagen Golf VII Sportsvan 1.4 TSI Highline BlueMotion Tech',
 'transmission': 'automatic',
 'trim': 'Highline BlueMotion Tech',
 'year': 2015}
2026-03-29 12:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DF82688%27 HTTP/1.1" 200 None
2026-03-29 12:00:44 [auto1.nl] INFO: Saving data for DF82688: {'auction_closing_time': 1774883655.0, 'created_time': 1773133345.831724, 'last_price_update_time': 1774785644.135467}
2026-03-29 12:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='DF82688') HTTP/1.1" 204 0
2026-03-29 12:00:44 [auto1.nl] INFO: Found listing with ID: RH35225
2026-03-29 12:00:44 [auto1.nl] INFO: Found listing with ID: CX09180
2026-03-29 12:00:44 [auto1.nl] INFO: Found listing with ID: BZ14164
2026-03-29 12:00:44 [auto1.nl] INFO: Found listing with ID: UE71777
2026-03-29 12:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UE71777%27 HTTP/1.1" 200 None
2026-03-29 12:00:44 [auto1.nl] INFO: Scrape type for UE71777: 1
2026-03-29 12:00:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FF33290/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 12:00:44 [auto1.nl] INFO: Found listing with ID: HV97203
2026-03-29 12:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HV97203%27 HTTP/1.1" 200 None
2026-03-29 12:00:44 [auto1.nl] INFO: Scrape type for HV97203: 2
2026-03-29 12:00:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ea8f8866-2ba3-532b-9d03-849dcc7e2468 with identifier: HV97203
2026-03-29 12:00:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ea8f8866-2ba3-532b-9d03-849dcc7e2468 with scrape type 2
2026-03-29 12:00:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ea8f8866-2ba3-532b-9d03-849dcc7e2468 with scrape type 2
2026-03-29 12:00:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: ea8f8866-2ba3-532b-9d03-849dcc7e2468, identifier: HV97203
2026-03-29 12:00:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: ea8f8866-2ba3-532b-9d03-849dcc7e2468 with identifier: HV97203
2026-03-29 12:00:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: ea8f8866-2ba3-532b-9d03-849dcc7e2468 with identifier: HV97203
2026-03-29 12:00:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: ea8f8866-2ba3-532b-9d03-849dcc7e2468 with identifier: HV97203 to the API
2026-03-29 12:00:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 12:00:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 12:00:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-30T15:59:29Z',
 'fuel_type': 'diesel',
 'id': 'ea8f8866-2ba3-532b-9d03-849dcc7e2468',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HV97203',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'V40',
 'odometer': 240575,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-12-29',
 'seller_name': None,
 'title': 'Volvo V40 2.0 D2 Summum',
 'transmission': 'manual',
 'trim': 'Summum',
 'year': 2015}
2026-03-29 12:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HV97203%27 HTTP/1.1" 200 None
2026-03-29 12:00:44 [auto1.nl] INFO: Saving data for HV97203: {'auction_closing_time': 1774886369.0, 'created_time': 1773229528.959622, 'last_price_update_time': 1774785644.575388}
2026-03-29 12:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='HV97203') HTTP/1.1" 204 0
2026-03-29 12:00:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 12:00:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 12:00:44 [auto1.nl] INFO: Channel: 24h | Page: 4 | totalHits: 759 | hits on page: 40
2026-03-29 12:00:44 [auto1.nl] INFO: Found listing with ID: UC71604
2026-03-29 12:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:00:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UC71604%27 HTTP/1.1" 200 None
2026-03-29 12:00:44 [auto1.nl] INFO: Scrape type for UC71604: 2
2026-03-29 12:00:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 14a3d914-dfa1-5086-980e-330ef6cc170a with identifier: UC71604
2026-03-29 12:00:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 14a3d914-dfa1-5086-980e-330ef6cc170a with scrape type 2
2026-03-29 12:00:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 14a3d914-dfa1-5086-980e-330ef6cc170a with scrape type 2
2026-03-29 12:00:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 14a3d914-dfa1-5086-980e-330ef6cc170a, identifier: UC71604
2026-03-29 12:00:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 14a3d914-dfa1-5086-980e-330ef6cc170a with identifier: UC71604
2026-03-29 12:00:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 14a3d914-dfa1-5086-980e-330ef6cc170a with identifier: UC71604
2026-03-29 12:00:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 14a3d914-dfa1-5086-980e-330ef6cc170a with identifier: UC71604 to the API
2026-03-29 12:00:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 12:00:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 12:00:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 67,
 'expiration_date': '2026-03-30T15:27:01Z',
 'fuel_type': 'petrol',
 'id': '14a3d914-dfa1-5086-980e-330ef6cc170a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UC71604',
 'listing': 'auction',
 'make': 'Kia',
 'model': 'Picanto',
 'odometer': 8025,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2024-02-05',
 'seller_name': None,
 'title': 'Kia Picanto 1.0 Vision',
 'transmission': 'manual',
 'trim': 'Vision',
 'year': 2024}
2026-03-29 12:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UC71604%27 HTTP/1.1" 200 None
2026-03-29 12:00:45 [auto1.nl] INFO: Saving data for UC71604: {'auction_closing_time': 1774884421.0, 'created_time': 1773947302.099136, 'last_price_update_time': 1774785645.154842}
2026-03-29 12:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='UC71604') HTTP/1.1" 204 0
2026-03-29 12:00:45 [auto1.nl] INFO: Found listing with ID: LT58475
2026-03-29 12:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LT58475%27 HTTP/1.1" 200 None
2026-03-29 12:00:45 [auto1.nl] INFO: Scrape type for LT58475: 0
2026-03-29 12:00:45 [auto1.nl] INFO: Found listing with ID: DJ99279
2026-03-29 12:00:45 [auto1.nl] INFO: Found listing with ID: LZ20154
2026-03-29 12:00:45 [auto1.nl] INFO: Found listing with ID: ZU81802
2026-03-29 12:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZU81802%27 HTTP/1.1" 200 None
2026-03-29 12:00:45 [auto1.nl] INFO: Scrape type for ZU81802: 0
2026-03-29 12:00:45 [auto1.nl] INFO: Found listing with ID: GW21106
2026-03-29 12:00:45 [auto1.nl] INFO: Found listing with ID: VV89778
2026-03-29 12:00:45 [auto1.nl] INFO: Found listing with ID: HT85176
2026-03-29 12:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HT85176%27 HTTP/1.1" 200 None
2026-03-29 12:00:45 [auto1.nl] INFO: Scrape type for HT85176: 0
2026-03-29 12:00:45 [auto1.nl] INFO: Found listing with ID: AR18023
2026-03-29 12:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AR18023%27 HTTP/1.1" 200 None
2026-03-29 12:00:45 [auto1.nl] INFO: Scrape type for AR18023: 0
2026-03-29 12:00:45 [auto1.nl] INFO: Found listing with ID: VV23298
2026-03-29 12:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VV23298%27 HTTP/1.1" 200 None
2026-03-29 12:00:45 [auto1.nl] INFO: Scrape type for VV23298: 0
2026-03-29 12:00:45 [auto1.nl] INFO: Found listing with ID: XZ29701
2026-03-29 12:00:45 [auto1.nl] INFO: Found listing with ID: UM83404
2026-03-29 12:00:45 [auto1.nl] INFO: Found listing with ID: TA68954
2026-03-29 12:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TA68954%27 HTTP/1.1" 200 None
2026-03-29 12:00:45 [auto1.nl] INFO: Scrape type for TA68954: 0
2026-03-29 12:00:45 [auto1.nl] INFO: Found listing with ID: MC92565
2026-03-29 12:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MC92565%27 HTTP/1.1" 200 None
2026-03-29 12:00:45 [auto1.nl] INFO: Scrape type for MC92565: 0
2026-03-29 12:00:45 [auto1.nl] INFO: Found listing with ID: JB49049
2026-03-29 12:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JB49049%27 HTTP/1.1" 200 None
2026-03-29 12:00:45 [auto1.nl] INFO: Scrape type for JB49049: 0
2026-03-29 12:00:45 [auto1.nl] INFO: Found listing with ID: ML03692
2026-03-29 12:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ML03692%27 HTTP/1.1" 200 None
2026-03-29 12:00:45 [auto1.nl] INFO: Scrape type for ML03692: 0
2026-03-29 12:00:45 [auto1.nl] INFO: Found listing with ID: GN29290
2026-03-29 12:00:45 [auto1.nl] INFO: Found listing with ID: KV65945
2026-03-29 12:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KV65945%27 HTTP/1.1" 200 None
2026-03-29 12:00:45 [auto1.nl] INFO: Scrape type for KV65945: 0
2026-03-29 12:00:45 [auto1.nl] INFO: Found listing with ID: AR80776
2026-03-29 12:00:45 [auto1.nl] INFO: Found listing with ID: EB25456
2026-03-29 12:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EB25456%27 HTTP/1.1" 200 None
2026-03-29 12:00:45 [auto1.nl] INFO: Scrape type for EB25456: 0
2026-03-29 12:00:45 [auto1.nl] INFO: Found listing with ID: ZR90330
2026-03-29 12:00:45 [auto1.nl] INFO: Found listing with ID: NV18219
2026-03-29 12:00:45 [auto1.nl] INFO: Found listing with ID: SA79399
2026-03-29 12:00:45 [auto1.nl] INFO: Found listing with ID: MR73967
2026-03-29 12:00:45 [auto1.nl] INFO: Found listing with ID: EY20513
2026-03-29 12:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EY20513%27 HTTP/1.1" 200 None
2026-03-29 12:00:45 [auto1.nl] INFO: Scrape type for EY20513: 0
2026-03-29 12:00:45 [auto1.nl] INFO: Found listing with ID: LX89920
2026-03-29 12:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LX89920%27 HTTP/1.1" 200 None
2026-03-29 12:00:45 [auto1.nl] INFO: Scrape type for LX89920: 0
2026-03-29 12:00:45 [auto1.nl] INFO: Found listing with ID: FZ85660
2026-03-29 12:00:45 [auto1.nl] INFO: Found listing with ID: BN23461
2026-03-29 12:00:45 [auto1.nl] INFO: Found listing with ID: VD03329
2026-03-29 12:00:45 [auto1.nl] INFO: Found listing with ID: JG46150
2026-03-29 12:00:45 [auto1.nl] INFO: Found listing with ID: MM65316
2026-03-29 12:00:45 [auto1.nl] INFO: Found listing with ID: TE70578
2026-03-29 12:00:45 [auto1.nl] INFO: Found listing with ID: WN75862
2026-03-29 12:00:45 [auto1.nl] INFO: Found listing with ID: UB57166
2026-03-29 12:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UB57166%27 HTTP/1.1" 200 None
2026-03-29 12:00:45 [auto1.nl] INFO: Scrape type for UB57166: 0
2026-03-29 12:00:45 [auto1.nl] INFO: Found listing with ID: FR61201
2026-03-29 12:00:45 [auto1.nl] INFO: Found listing with ID: RL60639
2026-03-29 12:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RL60639%27 HTTP/1.1" 200 None
2026-03-29 12:00:45 [auto1.nl] INFO: Scrape type for RL60639: 0
2026-03-29 12:00:45 [auto1.nl] INFO: Found listing with ID: HB74565
2026-03-29 12:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HB74565%27 HTTP/1.1" 200 None
2026-03-29 12:00:45 [auto1.nl] INFO: Scrape type for HB74565: 0
2026-03-29 12:00:45 [auto1.nl] INFO: Found listing with ID: SV00912
2026-03-29 12:00:45 [auto1.nl] INFO: Found listing with ID: JN77730
2026-03-29 12:00:45 [auto1.nl] INFO: Found listing with ID: AX06352
2026-03-29 12:00:45 [auto1.nl] INFO: Found listing with ID: YT76844
2026-03-29 12:00:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 12:00:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 12:00:45 [auto1.nl] INFO: Found listing with ID: GD44915
2026-03-29 12:00:45 [auto1.nl] INFO: Found listing with ID: AC01356
2026-03-29 12:00:45 [auto1.nl] INFO: Found listing with ID: HF10176
2026-03-29 12:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:00:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HF10176%27 HTTP/1.1" 200 None
2026-03-29 12:00:45 [auto1.nl] INFO: Scrape type for HF10176: 2
2026-03-29 12:00:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c454cb49-c890-5f14-bd4c-482023415706 with identifier: HF10176
2026-03-29 12:00:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c454cb49-c890-5f14-bd4c-482023415706 with scrape type 2
2026-03-29 12:00:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c454cb49-c890-5f14-bd4c-482023415706 with scrape type 2
2026-03-29 12:00:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: c454cb49-c890-5f14-bd4c-482023415706, identifier: HF10176
2026-03-29 12:00:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/KH55431/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 12:00:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: c454cb49-c890-5f14-bd4c-482023415706 with identifier: HF10176
2026-03-29 12:00:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: c454cb49-c890-5f14-bd4c-482023415706 with identifier: HF10176
2026-03-29 12:00:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: c454cb49-c890-5f14-bd4c-482023415706 with identifier: HF10176 to the API
2026-03-29 12:00:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 12:00:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 12:00:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 184,
 'expiration_date': '2026-03-30T15:30:42Z',
 'fuel_type': 'petrol',
 'id': 'c454cb49-c890-5f14-bd4c-482023415706',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HF10176',
 'listing': 'auction',
 'make': 'BMW',
 'model': '4er',
 'odometer': 27697,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-05-17',
 'seller_name': None,
 'title': 'BMW 4er 420i',
 'transmission': 'automatic',
 'trim': '',
 'year': 2021}
2026-03-29 12:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HF10176%27 HTTP/1.1" 200 None
2026-03-29 12:00:46 [auto1.nl] INFO: Saving data for HF10176: {'auction_closing_time': 1774884642.0, 'created_time': 1774465377.781767, 'last_price_update_time': 1774785646.092402}
2026-03-29 12:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='HF10176') HTTP/1.1" 204 0
2026-03-29 12:00:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 12:00:46 [auto1.nl] INFO: Found listing with ID: UG79878
2026-03-29 12:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UG79878%27 HTTP/1.1" 200 None
2026-03-29 12:00:46 [auto1.nl] INFO: Scrape type for UG79878: 1
2026-03-29 12:00:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/MB43165/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 12:00:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZE22789> (referer: https://www.auto1.com/v1/car-details-view/ZE22789/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 12:00:46 [auto1.nl] INFO: Found listing with ID: RL18676
2026-03-29 12:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RL18676%27 HTTP/1.1" 200 None
2026-03-29 12:00:46 [auto1.nl] INFO: Scrape type for RL18676: 2
2026-03-29 12:00:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7888771b-1c1d-55e9-beb7-2c5bad3225a3 with identifier: RL18676
2026-03-29 12:00:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7888771b-1c1d-55e9-beb7-2c5bad3225a3 with scrape type 2
2026-03-29 12:00:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7888771b-1c1d-55e9-beb7-2c5bad3225a3 with scrape type 2
2026-03-29 12:00:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 7888771b-1c1d-55e9-beb7-2c5bad3225a3, identifier: RL18676
2026-03-29 12:00:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 7888771b-1c1d-55e9-beb7-2c5bad3225a3 with identifier: RL18676
2026-03-29 12:00:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 7888771b-1c1d-55e9-beb7-2c5bad3225a3 with identifier: RL18676
2026-03-29 12:00:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 7888771b-1c1d-55e9-beb7-2c5bad3225a3 with identifier: RL18676 to the API
2026-03-29 12:00:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 12:00:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 12:00:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-30T15:37:36Z',
 'fuel_type': 'petrol',
 'id': '7888771b-1c1d-55e9-beb7-2c5bad3225a3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RL18676',
 'listing': 'auction',
 'make': 'MINI',
 'model': 'MINI',
 'odometer': 64319,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-04-04',
 'seller_name': None,
 'title': 'MINI Cooper',
 'transmission': 'manual',
 'trim': '',
 'year': 2018}
2026-03-29 12:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RL18676%27 HTTP/1.1" 200 None
2026-03-29 12:00:46 [auto1.nl] INFO: Saving data for RL18676: {'auction_closing_time': 1774885056.0, 'created_time': 1773132401.211667, 'last_price_update_time': 1774785646.636505}
2026-03-29 12:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='RL18676') HTTP/1.1" 204 0
2026-03-29 12:00:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 12:00:46 [auto1.nl] INFO: Found listing with ID: FD60498
2026-03-29 12:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FD60498%27 HTTP/1.1" 200 None
2026-03-29 12:00:46 [auto1.nl] INFO: Scrape type for FD60498: 2
2026-03-29 12:00:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 90db204c-5894-5d7f-a3b0-b7b9efb29e0e with identifier: FD60498
2026-03-29 12:00:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 90db204c-5894-5d7f-a3b0-b7b9efb29e0e with scrape type 2
2026-03-29 12:00:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 90db204c-5894-5d7f-a3b0-b7b9efb29e0e with scrape type 2
2026-03-29 12:00:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 90db204c-5894-5d7f-a3b0-b7b9efb29e0e, identifier: FD60498
2026-03-29 12:00:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 90db204c-5894-5d7f-a3b0-b7b9efb29e0e with identifier: FD60498
2026-03-29 12:00:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 90db204c-5894-5d7f-a3b0-b7b9efb29e0e with identifier: FD60498
2026-03-29 12:00:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 90db204c-5894-5d7f-a3b0-b7b9efb29e0e with identifier: FD60498 to the API
2026-03-29 12:00:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 12:00:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 12:00:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-30T15:17:52Z',
 'fuel_type': 'petrol',
 'id': '90db204c-5894-5d7f-a3b0-b7b9efb29e0e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FD60498',
 'listing': 'auction',
 'make': 'BMW',
 'model': '2er',
 'odometer': 160960,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-06-21',
 'seller_name': None,
 'title': 'BMW 2er 218i Active Tourer M Sport',
 'transmission': 'automatic',
 'trim': 'M Sport',
 'year': 2017}
2026-03-29 12:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FD60498%27 HTTP/1.1" 200 None
2026-03-29 12:00:47 [auto1.nl] INFO: Saving data for FD60498: {'auction_closing_time': 1774883872.0, 'created_time': 1773132796.498101, 'last_price_update_time': 1774785647.103807}
2026-03-29 12:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='FD60498') HTTP/1.1" 204 0
2026-03-29 12:00:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 681857c0-ef25-5c50-82a3-b1ecb348898e with identifier: ZE22789
2026-03-29 12:00:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 681857c0-ef25-5c50-82a3-b1ecb348898e with scrape type 1
2026-03-29 12:00:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 681857c0-ef25-5c50-82a3-b1ecb348898e
2026-03-29 12:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbf%252Fd7%252Fbfd78acdee5c4087ad593d89aac616dc%252Fpa%252FZE22789_06bfea453ed677fccd3910700d809e3b.jpg%27 HTTP/1.1" 200 None
2026-03-29 12:00:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/d7/bfd78acdee5c4087ad593d89aac616dc/pa/ZE22789_06bfea453ed677fccd3910700d809e3b.jpg already downloaded
2026-03-29 12:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbf%252Fd7%252Fbfd78acdee5c4087ad593d89aac616dc%252Fpa%252FZE22789_4bbea1323dcd26250551abda2250739f.jpg%27 HTTP/1.1" 200 None
2026-03-29 12:00:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/d7/bfd78acdee5c4087ad593d89aac616dc/pa/ZE22789_4bbea1323dcd26250551abda2250739f.jpg already downloaded
2026-03-29 12:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbf%252Fd7%252Fbfd78acdee5c4087ad593d89aac616dc%252Fpa%252FZE22789_06d2e13f4c495a837e9b94ba38277231.jpg%27 HTTP/1.1" 200 None
2026-03-29 12:00:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/d7/bfd78acdee5c4087ad593d89aac616dc/pa/ZE22789_06d2e13f4c495a837e9b94ba38277231.jpg already downloaded
2026-03-29 12:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbf%252Fd7%252Fbfd78acdee5c4087ad593d89aac616dc%252Fpa%252FZE22789_915baef798d1eca4704d296dc944673a.jpg%27 HTTP/1.1" 200 None
2026-03-29 12:00:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/d7/bfd78acdee5c4087ad593d89aac616dc/pa/ZE22789_915baef798d1eca4704d296dc944673a.jpg already downloaded
2026-03-29 12:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbf%252Fd7%252Fbfd78acdee5c4087ad593d89aac616dc%252Fpa%252FZE22789_8e168d06bbe5c9fe093cfb1ac3baec6f.jpg%27 HTTP/1.1" 200 None
2026-03-29 12:00:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/d7/bfd78acdee5c4087ad593d89aac616dc/pa/ZE22789_8e168d06bbe5c9fe093cfb1ac3baec6f.jpg already downloaded
2026-03-29 12:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbf%252Fd7%252Fbfd78acdee5c4087ad593d89aac616dc%252Fpa%252FZE22789_e3b5a24e4512e06c82c8e6d31f19b147.jpg%27 HTTP/1.1" 200 None
2026-03-29 12:00:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/d7/bfd78acdee5c4087ad593d89aac616dc/pa/ZE22789_e3b5a24e4512e06c82c8e6d31f19b147.jpg already downloaded
2026-03-29 12:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbf%252Fd7%252Fbfd78acdee5c4087ad593d89aac616dc%252Fpa%252FZE22789_c771b3d24f82b8d60fb94c16ee4c1b58.jpg%27 HTTP/1.1" 200 None
2026-03-29 12:00:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/d7/bfd78acdee5c4087ad593d89aac616dc/pa/ZE22789_c771b3d24f82b8d60fb94c16ee4c1b58.jpg already downloaded
2026-03-29 12:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbf%252Fd7%252Fbfd78acdee5c4087ad593d89aac616dc%252Fpa%252FZE22789_064e5c346eb7861bd529137d98f3216c.jpg%27 HTTP/1.1" 200 None
2026-03-29 12:00:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/d7/bfd78acdee5c4087ad593d89aac616dc/pa/ZE22789_064e5c346eb7861bd529137d98f3216c.jpg already downloaded
2026-03-29 12:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbf%252Fd7%252Fbfd78acdee5c4087ad593d89aac616dc%252Fpa%252FZE22789_aa8c9a1b3e6b6cdda8e72493e161496a.jpg%27 HTTP/1.1" 200 None
2026-03-29 12:00:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/d7/bfd78acdee5c4087ad593d89aac616dc/pa/ZE22789_aa8c9a1b3e6b6cdda8e72493e161496a.jpg already downloaded
2026-03-29 12:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgbf%252Fd7%252Fbfd78acdee5c4087ad593d89aac616dc%252Fpa%252FZE22789_757166d700f2ad1170259ad6f4709442.jpg%27 HTTP/1.1" 200 None
2026-03-29 12:00:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgbf/d7/bfd78acdee5c4087ad593d89aac616dc/pa/ZE22789_757166d700f2ad1170259ad6f4709442.jpg already downloaded
2026-03-29 12:00:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 681857c0-ef25-5c50-82a3-b1ecb348898e, identifier: ZE22789
2026-03-29 12:00:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 12:00:47 [auto1.nl] INFO: Found listing with ID: JL68792
2026-03-29 12:00:47 [auto1.nl] INFO: Found listing with ID: VP11309
2026-03-29 12:00:47 [auto1.nl] INFO: Found listing with ID: GW54855
2026-03-29 12:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GW54855%27 HTTP/1.1" 200 None
2026-03-29 12:00:47 [auto1.nl] INFO: Scrape type for GW54855: 2
2026-03-29 12:00:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 38b64c25-e6d4-5417-919d-627f473fda70 with identifier: GW54855
2026-03-29 12:00:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 38b64c25-e6d4-5417-919d-627f473fda70 with scrape type 2
2026-03-29 12:00:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 38b64c25-e6d4-5417-919d-627f473fda70 with scrape type 2
2026-03-29 12:00:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 38b64c25-e6d4-5417-919d-627f473fda70, identifier: GW54855
2026-03-29 12:00:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 681857c0-ef25-5c50-82a3-b1ecb348898e with identifier: ZE22789
2026-03-29 12:00:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 681857c0-ef25-5c50-82a3-b1ecb348898e with identifier: ZE22789
2026-03-29 12:00:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 681857c0-ef25-5c50-82a3-b1ecb348898e with identifier: ZE22789 to the API
2026-03-29 12:00:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 12:00:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 12:00:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/ZE22789>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6D',
 'engine': '2.0L',
 'engine_horse_power': 292,
 'expiration_date': '2026-03-30T15:19:02Z',
 'fuel_type': 'hybrid',
 'id': '681857c0-ef25-5c50-82a3-b1ecb348898e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZE22789',
 'listing': 'auction',
 'location': 'NL, Oosterhout',
 'make': 'BMW',
 'model': '5er',
 'odometer': 76421,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/imgbf/d7/bfd78acdee5c4087ad593d89aac616dc/pa/ZE22789_06bfea453ed677fccd3910700d809e3b.jpg',
                'https://img-pa.auto1.com/imgbf/d7/bfd78acdee5c4087ad593d89aac616dc/pa/ZE22789_4bbea1323dcd26250551abda2250739f.jpg',
                'https://img-pa.auto1.com/imgbf/d7/bfd78acdee5c4087ad593d89aac616dc/pa/ZE22789_06d2e13f4c495a837e9b94ba38277231.jpg',
                'https://img-pa.auto1.com/imgbf/d7/bfd78acdee5c4087ad593d89aac616dc/pa/ZE22789_915baef798d1eca4704d296dc944673a.jpg',
                'https://img-pa.auto1.com/imgbf/d7/bfd78acdee5c4087ad593d89aac616dc/pa/ZE22789_8e168d06bbe5c9fe093cfb1ac3baec6f.jpg',
                'https://img-pa.auto1.com/imgbf/d7/bfd78acdee5c4087ad593d89aac616dc/pa/ZE22789_e3b5a24e4512e06c82c8e6d31f19b147.jpg',
                'https://img-pa.auto1.com/imgbf/d7/bfd78acdee5c4087ad593d89aac616dc/pa/ZE22789_c771b3d24f82b8d60fb94c16ee4c1b58.jpg',
                'https://img-pa.auto1.com/imgbf/d7/bfd78acdee5c4087ad593d89aac616dc/pa/ZE22789_064e5c346eb7861bd529137d98f3216c.jpg',
                'https://img-pa.auto1.com/imgbf/d7/bfd78acdee5c4087ad593d89aac616dc/pa/ZE22789_aa8c9a1b3e6b6cdda8e72493e161496a.jpg',
                'https://img-pa.auto1.com/imgbf/d7/bfd78acdee5c4087ad593d89aac616dc/pa/ZE22789_757166d700f2ad1170259ad6f4709442.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_681857c0-ef25-5c50-82a3-b1ecb348898e/681857c0-ef25-5c50-82a3-b1ecb348898e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 117360,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbf/d7/bfd78acdee5c4087ad593d89aac616dc/pa/ZE22789_06bfea453ed677fccd3910700d809e3b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_681857c0-ef25-5c50-82a3-b1ecb348898e/681857c0-ef25-5c50-82a3-b1ecb348898e_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 99555,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbf/d7/bfd78acdee5c4087ad593d89aac616dc/pa/ZE22789_4bbea1323dcd26250551abda2250739f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_681857c0-ef25-5c50-82a3-b1ecb348898e/681857c0-ef25-5c50-82a3-b1ecb348898e_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83295,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbf/d7/bfd78acdee5c4087ad593d89aac616dc/pa/ZE22789_06d2e13f4c495a837e9b94ba38277231.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_681857c0-ef25-5c50-82a3-b1ecb348898e/681857c0-ef25-5c50-82a3-b1ecb348898e_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87074,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbf/d7/bfd78acdee5c4087ad593d89aac616dc/pa/ZE22789_915baef798d1eca4704d296dc944673a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_681857c0-ef25-5c50-82a3-b1ecb348898e/681857c0-ef25-5c50-82a3-b1ecb348898e_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82959,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbf/d7/bfd78acdee5c4087ad593d89aac616dc/pa/ZE22789_8e168d06bbe5c9fe093cfb1ac3baec6f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_681857c0-ef25-5c50-82a3-b1ecb348898e/681857c0-ef25-5c50-82a3-b1ecb348898e_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 103611,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbf/d7/bfd78acdee5c4087ad593d89aac616dc/pa/ZE22789_e3b5a24e4512e06c82c8e6d31f19b147.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_681857c0-ef25-5c50-82a3-b1ecb348898e/681857c0-ef25-5c50-82a3-b1ecb348898e_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63376,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbf/d7/bfd78acdee5c4087ad593d89aac616dc/pa/ZE22789_c771b3d24f82b8d60fb94c16ee4c1b58.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_681857c0-ef25-5c50-82a3-b1ecb348898e/681857c0-ef25-5c50-82a3-b1ecb348898e_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 98348,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbf/d7/bfd78acdee5c4087ad593d89aac616dc/pa/ZE22789_064e5c346eb7861bd529137d98f3216c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_681857c0-ef25-5c50-82a3-b1ecb348898e/681857c0-ef25-5c50-82a3-b1ecb348898e_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 100356,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbf/d7/bfd78acdee5c4087ad593d89aac616dc/pa/ZE22789_aa8c9a1b3e6b6cdda8e72493e161496a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_681857c0-ef25-5c50-82a3-b1ecb348898e/681857c0-ef25-5c50-82a3-b1ecb348898e_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60379,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgbf/d7/bfd78acdee5c4087ad593d89aac616dc/pa/ZE22789_757166d700f2ad1170259ad6f4709442.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-09-25',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 5er 530e M Sport',
 'transmission': 'automatic',
 'trim': 'M Sport',
 'year': 2022}
2026-03-29 12:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZE22789%27 HTTP/1.1" 200 None
2026-03-29 12:00:47 [auto1.nl] INFO: Saving data for ZE22789: {'created_time': 1774785647.858606, 'last_price_update_time': 1774785647.858618, 'auction_closing_time': 1774883942.0}
2026-03-29 12:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='ZE22789') HTTP/1.1" 204 0
2026-03-29 12:00:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 38b64c25-e6d4-5417-919d-627f473fda70 with identifier: GW54855
2026-03-29 12:00:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 12:00:47 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=brown HTTP/1.1" 200 None
2026-03-29 12:00:47 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 12:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 12:00:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 38b64c25-e6d4-5417-919d-627f473fda70 with identifier: GW54855
2026-03-29 12:00:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 38b64c25-e6d4-5417-919d-627f473fda70 with identifier: GW54855 to the API
2026-03-29 12:00:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 12:00:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 12:00:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-30T15:20:29Z',
 'fuel_type': 'diesel',
 'id': '38b64c25-e6d4-5417-919d-627f473fda70',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GW54855',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Scenic',
 'odometer': 328492,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-07-08',
 'seller_name': None,
 'title': 'Renault Scenic 1.5 dCi Expression',
 'transmission': 'manual',
 'trim': 'Expression',
 'year': 2009}
2026-03-29 12:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GW54855%27 HTTP/1.1" 200 None
2026-03-29 12:00:48 [auto1.nl] INFO: Saving data for GW54855: {'auction_closing_time': 1774884029.0, 'created_time': 1773131927.613367, 'last_price_update_time': 1774785648.3738}
2026-03-29 12:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='GW54855') HTTP/1.1" 204 0
2026-03-29 12:00:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 12:00:48 [auto1.nl] INFO: Found listing with ID: XJ86601
2026-03-29 12:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XJ86601%27 HTTP/1.1" 200 None
2026-03-29 12:00:48 [auto1.nl] INFO: Scrape type for XJ86601: 2
2026-03-29 12:00:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1a74828f-287e-5201-9335-16a8f15c19f1 with identifier: XJ86601
2026-03-29 12:00:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1a74828f-287e-5201-9335-16a8f15c19f1 with scrape type 2
2026-03-29 12:00:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1a74828f-287e-5201-9335-16a8f15c19f1 with scrape type 2
2026-03-29 12:00:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 1a74828f-287e-5201-9335-16a8f15c19f1, identifier: XJ86601
2026-03-29 12:00:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 1a74828f-287e-5201-9335-16a8f15c19f1 with identifier: XJ86601
2026-03-29 12:00:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 1a74828f-287e-5201-9335-16a8f15c19f1 with identifier: XJ86601
2026-03-29 12:00:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 1a74828f-287e-5201-9335-16a8f15c19f1 with identifier: XJ86601 to the API
2026-03-29 12:00:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 12:00:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 12:00:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 252,
 'expiration_date': '2026-03-30T15:28:20Z',
 'fuel_type': 'petrol',
 'id': '1a74828f-287e-5201-9335-16a8f15c19f1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XJ86601',
 'listing': 'auction',
 'make': 'Porsche',
 'model': 'Macan',
 'odometer': 102359,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-11-15',
 'seller_name': None,
 'title': 'Porsche Macan 2.0',
 'transmission': 'automatic',
 'trim': '',
 'year': 2018}
2026-03-29 12:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XJ86601%27 HTTP/1.1" 200 None
2026-03-29 12:00:49 [auto1.nl] INFO: Saving data for XJ86601: {'auction_closing_time': 1774884500.0, 'created_time': 1773301459.292838, 'last_price_update_time': 1774785649.178752}
2026-03-29 12:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='XJ86601') HTTP/1.1" 204 0
2026-03-29 12:00:49 [auto1.nl] INFO: Found listing with ID: ZY88945
2026-03-29 12:00:49 [auto1.nl] INFO: Found listing with ID: FT93592
2026-03-29 12:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FT93592%27 HTTP/1.1" 200 None
2026-03-29 12:00:49 [auto1.nl] INFO: Scrape type for FT93592: 2
2026-03-29 12:00:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 50da3f30-d841-5fb5-a493-8e3e1c5feb15 with identifier: FT93592
2026-03-29 12:00:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 50da3f30-d841-5fb5-a493-8e3e1c5feb15 with scrape type 2
2026-03-29 12:00:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 50da3f30-d841-5fb5-a493-8e3e1c5feb15 with scrape type 2
2026-03-29 12:00:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 50da3f30-d841-5fb5-a493-8e3e1c5feb15, identifier: FT93592
2026-03-29 12:00:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DJ12615> (referer: https://www.auto1.com/v1/car-details-view/DJ12615/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 12:00:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/XU83484> (referer: https://www.auto1.com/v1/car-details-view/XU83484/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 12:00:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UE71777/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 12:00:49 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 12:00:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 50da3f30-d841-5fb5-a493-8e3e1c5feb15 with identifier: FT93592
2026-03-29 12:00:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 50da3f30-d841-5fb5-a493-8e3e1c5feb15 with identifier: FT93592
2026-03-29 12:00:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 50da3f30-d841-5fb5-a493-8e3e1c5feb15 with identifier: FT93592 to the API
2026-03-29 12:00:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 12:00:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 12:00:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 163,
 'expiration_date': '2026-03-30T15:26:16Z',
 'fuel_type': 'diesel',
 'id': '50da3f30-d841-5fb5-a493-8e3e1c5feb15',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FT93592',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'Jumper',
 'odometer': 143606,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-06-07',
 'seller_name': None,
 'title': 'Citroen Jumper 2.0 Blue-HDi 35 L4 Heavy BlueHDi',
 'transmission': 'manual',
 'trim': '35 L4 Heavy BlueHDi',
 'year': 2018}
2026-03-29 12:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FT93592%27 HTTP/1.1" 200 None
2026-03-29 12:00:49 [auto1.nl] INFO: Saving data for FT93592: {'auction_closing_time': 1774884376.0, 'created_time': 1773132799.005079, 'last_price_update_time': 1774785649.664915}
2026-03-29 12:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='FT93592') HTTP/1.1" 204 0
2026-03-29 12:00:49 [auto1.nl] INFO: Found listing with ID: TT87192
2026-03-29 12:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TT87192%27 HTTP/1.1" 200 None
2026-03-29 12:00:49 [auto1.nl] INFO: Scrape type for TT87192: 1
2026-03-29 12:00:49 [auto1.nl] INFO: Found listing with ID: KX21734
2026-03-29 12:00:49 [auto1.nl] INFO: Found listing with ID: EP75091
2026-03-29 12:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EP75091%27 HTTP/1.1" 200 None
2026-03-29 12:00:49 [auto1.nl] INFO: Scrape type for EP75091: 0
2026-03-29 12:00:49 [auto1.nl] INFO: Found listing with ID: HR57884
2026-03-29 12:00:49 [auto1.nl] INFO: Found listing with ID: PT29526
2026-03-29 12:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PT29526%27 HTTP/1.1" 200 None
2026-03-29 12:00:49 [auto1.nl] INFO: Scrape type for PT29526: 0
2026-03-29 12:00:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 12:00:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8ed63732-fa94-5bde-987e-9cf82c512b0a with identifier: DJ12615
2026-03-29 12:00:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8ed63732-fa94-5bde-987e-9cf82c512b0a with scrape type 1
2026-03-29 12:00:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 8ed63732-fa94-5bde-987e-9cf82c512b0a
2026-03-29 12:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252Fa5%252Fe8a59fe3990968c845526696412f47e9%252Fpa%252FDJ12615_93fb7b0774e86d9c898590b28c102d37.jpg%27 HTTP/1.1" 200 None
2026-03-29 12:00:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/a5/e8a59fe3990968c845526696412f47e9/pa/DJ12615_93fb7b0774e86d9c898590b28c102d37.jpg already downloaded
2026-03-29 12:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252Fa5%252Fe8a59fe3990968c845526696412f47e9%252Fpa%252FDJ12615_72d602f7ccf2be8e6bcc7869de8ea8b6.jpg%27 HTTP/1.1" 200 None
2026-03-29 12:00:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/a5/e8a59fe3990968c845526696412f47e9/pa/DJ12615_72d602f7ccf2be8e6bcc7869de8ea8b6.jpg already downloaded
2026-03-29 12:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252Fa5%252Fe8a59fe3990968c845526696412f47e9%252Fpa%252FDJ12615_1525f49a549084466204797089387f89.jpg%27 HTTP/1.1" 200 None
2026-03-29 12:00:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/a5/e8a59fe3990968c845526696412f47e9/pa/DJ12615_1525f49a549084466204797089387f89.jpg already downloaded
2026-03-29 12:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252Fa5%252Fe8a59fe3990968c845526696412f47e9%252Fpa%252FDJ12615_8fee80242c48f01779cb95bbe7ccd6fd.jpg%27 HTTP/1.1" 200 None
2026-03-29 12:00:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/a5/e8a59fe3990968c845526696412f47e9/pa/DJ12615_8fee80242c48f01779cb95bbe7ccd6fd.jpg already downloaded
2026-03-29 12:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge8%252Fa5%252Fe8a59fe3990968c845526696412f47e9%252Fpa%252FDJ12615_0bd9ee7c550ec4634a0881238ceeeab4.jpg%27 HTTP/1.1" 200 None
2026-03-29 12:00:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge8/a5/e8a59fe3990968c845526696412f47e9/pa/DJ12615_0bd9ee7c550ec4634a0881238ceeeab4.jpg already downloaded
2026-03-29 12:00:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 8ed63732-fa94-5bde-987e-9cf82c512b0a, identifier: DJ12615
2026-03-29 12:00:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2dfa3de0-a40c-5cc4-9fcc-81670f3c433b with identifier: XU83484
2026-03-29 12:00:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2dfa3de0-a40c-5cc4-9fcc-81670f3c433b with scrape type 1
2026-03-29 12:00:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 2dfa3de0-a40c-5cc4-9fcc-81670f3c433b
2026-03-29 12:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga5%252Fb1%252Fa5b1d56dd63c2dc7e737467a5211ab1d%252Fpa%252FXU83484_e50446cac2682c2232de1824da2b75b0.jpg%27 HTTP/1.1" 200 None
2026-03-29 12:00:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/b1/a5b1d56dd63c2dc7e737467a5211ab1d/pa/XU83484_e50446cac2682c2232de1824da2b75b0.jpg already downloaded
2026-03-29 12:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga5%252Fb1%252Fa5b1d56dd63c2dc7e737467a5211ab1d%252Fpa%252FXU83484_02c7d8e81a12fdfca11f2a90ace644b3.jpg%27 HTTP/1.1" 200 None
2026-03-29 12:00:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/b1/a5b1d56dd63c2dc7e737467a5211ab1d/pa/XU83484_02c7d8e81a12fdfca11f2a90ace644b3.jpg already downloaded
2026-03-29 12:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga5%252Fb1%252Fa5b1d56dd63c2dc7e737467a5211ab1d%252Fpa%252FXU83484_5572bf207e3a63e03dc2370677b2c5a0.jpg%27 HTTP/1.1" 200 None
2026-03-29 12:00:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/b1/a5b1d56dd63c2dc7e737467a5211ab1d/pa/XU83484_5572bf207e3a63e03dc2370677b2c5a0.jpg already downloaded
2026-03-29 12:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga5%252Fb1%252Fa5b1d56dd63c2dc7e737467a5211ab1d%252Fpa%252FXU83484_8f34523d60440ea6efc2bdb7eb63a914.jpg%27 HTTP/1.1" 200 None
2026-03-29 12:00:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/b1/a5b1d56dd63c2dc7e737467a5211ab1d/pa/XU83484_8f34523d60440ea6efc2bdb7eb63a914.jpg already downloaded
2026-03-29 12:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga5%252Fb1%252Fa5b1d56dd63c2dc7e737467a5211ab1d%252Fpa%252FXU83484_ac80d67a12f251a8737da784a319da22.jpg%27 HTTP/1.1" 200 None
2026-03-29 12:00:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/b1/a5b1d56dd63c2dc7e737467a5211ab1d/pa/XU83484_ac80d67a12f251a8737da784a319da22.jpg already downloaded
2026-03-29 12:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga5%252Fb1%252Fa5b1d56dd63c2dc7e737467a5211ab1d%252Fpa%252FXU83484_3824da9867176a8d6e66fa795f67ae0a.jpg%27 HTTP/1.1" 200 None
2026-03-29 12:00:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/b1/a5b1d56dd63c2dc7e737467a5211ab1d/pa/XU83484_3824da9867176a8d6e66fa795f67ae0a.jpg already downloaded
2026-03-29 12:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga5%252Fb1%252Fa5b1d56dd63c2dc7e737467a5211ab1d%252Fpa%252FXU83484_b7df76525bcca5854bbbaf478889cbe2.jpg%27 HTTP/1.1" 200 None
2026-03-29 12:00:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/b1/a5b1d56dd63c2dc7e737467a5211ab1d/pa/XU83484_b7df76525bcca5854bbbaf478889cbe2.jpg already downloaded
2026-03-29 12:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga5%252Fb1%252Fa5b1d56dd63c2dc7e737467a5211ab1d%252Fpa%252FXU83484_50520411ae706d018beadac57895359b.jpg%27 HTTP/1.1" 200 None
2026-03-29 12:00:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/b1/a5b1d56dd63c2dc7e737467a5211ab1d/pa/XU83484_50520411ae706d018beadac57895359b.jpg already downloaded
2026-03-29 12:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga5%252Fb1%252Fa5b1d56dd63c2dc7e737467a5211ab1d%252Fpa%252FXU83484_4022aac15d931f0148c6f7939f37a51b.jpg%27 HTTP/1.1" 200 None
2026-03-29 12:00:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/b1/a5b1d56dd63c2dc7e737467a5211ab1d/pa/XU83484_4022aac15d931f0148c6f7939f37a51b.jpg already downloaded
2026-03-29 12:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga5%252Fb1%252Fa5b1d56dd63c2dc7e737467a5211ab1d%252Fpa%252FXU83484_b8adeb26a4715a79d1b7017b47c33f6d.jpg%27 HTTP/1.1" 200 None
2026-03-29 12:00:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/b1/a5b1d56dd63c2dc7e737467a5211ab1d/pa/XU83484_b8adeb26a4715a79d1b7017b47c33f6d.jpg already downloaded
2026-03-29 12:00:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 2dfa3de0-a40c-5cc4-9fcc-81670f3c433b, identifier: XU83484
2026-03-29 12:00:50 [auto1.nl] INFO: Channel: 24h | Page: 5 | totalHits: 759 | hits on page: 40
2026-03-29 12:00:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 8ed63732-fa94-5bde-987e-9cf82c512b0a with identifier: DJ12615
2026-03-29 12:00:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 8ed63732-fa94-5bde-987e-9cf82c512b0a with identifier: DJ12615
2026-03-29 12:00:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 8ed63732-fa94-5bde-987e-9cf82c512b0a with identifier: DJ12615 to the API
2026-03-29 12:00:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 12:00:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 12:00:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/DJ12615>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '1.2L',
 'engine_horse_power': 75,
 'expiration_date': '2026-03-30T15:16:32Z',
 'fuel_type': 'petrol',
 'id': '8ed63732-fa94-5bde-987e-9cf82c512b0a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': '44PHXB',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DJ12615',
 'listing': 'auction',
 'location': 'NL, Oosterhout',
 'make': 'Opel',
 'model': 'Agila',
 'odometer': 135085,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 5,
 'photo_urls': ['https://img-pa.auto1.com/imge8/a5/e8a59fe3990968c845526696412f47e9/pa/DJ12615_93fb7b0774e86d9c898590b28c102d37.jpg',
                'https://img-pa.auto1.com/imge8/a5/e8a59fe3990968c845526696412f47e9/pa/DJ12615_72d602f7ccf2be8e6bcc7869de8ea8b6.jpg',
                'https://img-pa.auto1.com/imge8/a5/e8a59fe3990968c845526696412f47e9/pa/DJ12615_1525f49a549084466204797089387f89.jpg',
                'https://img-pa.auto1.com/imge8/a5/e8a59fe3990968c845526696412f47e9/pa/DJ12615_8fee80242c48f01779cb95bbe7ccd6fd.jpg',
                'https://img-pa.auto1.com/imge8/a5/e8a59fe3990968c845526696412f47e9/pa/DJ12615_0bd9ee7c550ec4634a0881238ceeeab4.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8ed63732-fa94-5bde-987e-9cf82c512b0a/8ed63732-fa94-5bde-987e-9cf82c512b0a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75655,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge8/a5/e8a59fe3990968c845526696412f47e9/pa/DJ12615_93fb7b0774e86d9c898590b28c102d37.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8ed63732-fa94-5bde-987e-9cf82c512b0a/8ed63732-fa94-5bde-987e-9cf82c512b0a_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69627,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge8/a5/e8a59fe3990968c845526696412f47e9/pa/DJ12615_72d602f7ccf2be8e6bcc7869de8ea8b6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8ed63732-fa94-5bde-987e-9cf82c512b0a/8ed63732-fa94-5bde-987e-9cf82c512b0a_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59856,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge8/a5/e8a59fe3990968c845526696412f47e9/pa/DJ12615_1525f49a549084466204797089387f89.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8ed63732-fa94-5bde-987e-9cf82c512b0a/8ed63732-fa94-5bde-987e-9cf82c512b0a_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57503,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge8/a5/e8a59fe3990968c845526696412f47e9/pa/DJ12615_8fee80242c48f01779cb95bbe7ccd6fd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8ed63732-fa94-5bde-987e-9cf82c512b0a/8ed63732-fa94-5bde-987e-9cf82c512b0a_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 39040,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge8/a5/e8a59fe3990968c845526696412f47e9/pa/DJ12615_0bd9ee7c550ec4634a0881238ceeeab4.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2004-06-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Opel Agila 1.2 Basis',
 'transmission': 'manual',
 'trim': 'Basis',
 'year': 2004}
2026-03-29 12:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DJ12615%27 HTTP/1.1" 200 None
2026-03-29 12:00:50 [auto1.nl] INFO: Saving data for DJ12615: {'created_time': 1774785650.649993, 'last_price_update_time': 1774785650.650004, 'auction_closing_time': 1774883792.0}
2026-03-29 12:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='DJ12615') HTTP/1.1" 204 0
2026-03-29 12:00:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 2dfa3de0-a40c-5cc4-9fcc-81670f3c433b with identifier: XU83484
2026-03-29 12:00:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 2dfa3de0-a40c-5cc4-9fcc-81670f3c433b with identifier: XU83484
2026-03-29 12:00:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 2dfa3de0-a40c-5cc4-9fcc-81670f3c433b with identifier: XU83484 to the API
2026-03-29 12:00:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 12:00:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 12:00:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/XU83484>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 2,
 'emission_standard': 'EURO 5',
 'engine': '3.5L',
 'engine_horse_power': 292,
 'expiration_date': '2026-03-30T15:32:42Z',
 'fuel_type': 'petrol',
 'id': '2dfa3de0-a40c-5cc4-9fcc-81670f3c433b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': '35JVG3',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XU83484',
 'listing': 'auction',
 'location': 'NL, Oosterhout',
 'make': 'Mercedes-Benz',
 'model': 'E-Klasse',
 'odometer': 166207,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/imga5/b1/a5b1d56dd63c2dc7e737467a5211ab1d/pa/XU83484_e50446cac2682c2232de1824da2b75b0.jpg',
                'https://img-pa.auto1.com/imga5/b1/a5b1d56dd63c2dc7e737467a5211ab1d/pa/XU83484_02c7d8e81a12fdfca11f2a90ace644b3.jpg',
                'https://img-pa.auto1.com/imga5/b1/a5b1d56dd63c2dc7e737467a5211ab1d/pa/XU83484_5572bf207e3a63e03dc2370677b2c5a0.jpg',
                'https://img-pa.auto1.com/imga5/b1/a5b1d56dd63c2dc7e737467a5211ab1d/pa/XU83484_8f34523d60440ea6efc2bdb7eb63a914.jpg',
                'https://img-pa.auto1.com/imga5/b1/a5b1d56dd63c2dc7e737467a5211ab1d/pa/XU83484_ac80d67a12f251a8737da784a319da22.jpg',
                'https://img-pa.auto1.com/imga5/b1/a5b1d56dd63c2dc7e737467a5211ab1d/pa/XU83484_3824da9867176a8d6e66fa795f67ae0a.jpg',
                'https://img-pa.auto1.com/imga5/b1/a5b1d56dd63c2dc7e737467a5211ab1d/pa/XU83484_b7df76525bcca5854bbbaf478889cbe2.jpg',
                'https://img-pa.auto1.com/imga5/b1/a5b1d56dd63c2dc7e737467a5211ab1d/pa/XU83484_50520411ae706d018beadac57895359b.jpg',
                'https://img-pa.auto1.com/imga5/b1/a5b1d56dd63c2dc7e737467a5211ab1d/pa/XU83484_4022aac15d931f0148c6f7939f37a51b.jpg',
                'https://img-pa.auto1.com/imga5/b1/a5b1d56dd63c2dc7e737467a5211ab1d/pa/XU83484_b8adeb26a4715a79d1b7017b47c33f6d.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2dfa3de0-a40c-5cc4-9fcc-81670f3c433b/2dfa3de0-a40c-5cc4-9fcc-81670f3c433b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74440,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga5/b1/a5b1d56dd63c2dc7e737467a5211ab1d/pa/XU83484_e50446cac2682c2232de1824da2b75b0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2dfa3de0-a40c-5cc4-9fcc-81670f3c433b/2dfa3de0-a40c-5cc4-9fcc-81670f3c433b_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58954,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga5/b1/a5b1d56dd63c2dc7e737467a5211ab1d/pa/XU83484_02c7d8e81a12fdfca11f2a90ace644b3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2dfa3de0-a40c-5cc4-9fcc-81670f3c433b/2dfa3de0-a40c-5cc4-9fcc-81670f3c433b_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75022,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga5/b1/a5b1d56dd63c2dc7e737467a5211ab1d/pa/XU83484_5572bf207e3a63e03dc2370677b2c5a0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2dfa3de0-a40c-5cc4-9fcc-81670f3c433b/2dfa3de0-a40c-5cc4-9fcc-81670f3c433b_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56560,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga5/b1/a5b1d56dd63c2dc7e737467a5211ab1d/pa/XU83484_8f34523d60440ea6efc2bdb7eb63a914.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2dfa3de0-a40c-5cc4-9fcc-81670f3c433b/2dfa3de0-a40c-5cc4-9fcc-81670f3c433b_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71903,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga5/b1/a5b1d56dd63c2dc7e737467a5211ab1d/pa/XU83484_ac80d67a12f251a8737da784a319da22.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2dfa3de0-a40c-5cc4-9fcc-81670f3c433b/2dfa3de0-a40c-5cc4-9fcc-81670f3c433b_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74301,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga5/b1/a5b1d56dd63c2dc7e737467a5211ab1d/pa/XU83484_3824da9867176a8d6e66fa795f67ae0a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2dfa3de0-a40c-5cc4-9fcc-81670f3c433b/2dfa3de0-a40c-5cc4-9fcc-81670f3c433b_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54873,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga5/b1/a5b1d56dd63c2dc7e737467a5211ab1d/pa/XU83484_b7df76525bcca5854bbbaf478889cbe2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2dfa3de0-a40c-5cc4-9fcc-81670f3c433b/2dfa3de0-a40c-5cc4-9fcc-81670f3c433b_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79681,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga5/b1/a5b1d56dd63c2dc7e737467a5211ab1d/pa/XU83484_50520411ae706d018beadac57895359b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2dfa3de0-a40c-5cc4-9fcc-81670f3c433b/2dfa3de0-a40c-5cc4-9fcc-81670f3c433b_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74420,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga5/b1/a5b1d56dd63c2dc7e737467a5211ab1d/pa/XU83484_4022aac15d931f0148c6f7939f37a51b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2dfa3de0-a40c-5cc4-9fcc-81670f3c433b/2dfa3de0-a40c-5cc4-9fcc-81670f3c433b_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75016,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga5/b1/a5b1d56dd63c2dc7e737467a5211ab1d/pa/XU83484_b8adeb26a4715a79d1b7017b47c33f6d.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2009-09-02',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Mercedes-Benz E-Klasse E 350 CGI BlueEfficiency Avantgarde',
 'transmission': 'automatic',
 'trim': 'BlueEfficiency Avantgarde',
 'year': 2009}
2026-03-29 12:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XU83484%27 HTTP/1.1" 200 None
2026-03-29 12:00:51 [auto1.nl] INFO: Saving data for XU83484: {'created_time': 1774785651.057075, 'last_price_update_time': 1774785651.057086, 'auction_closing_time': 1774884762.0}
2026-03-29 12:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='XU83484') HTTP/1.1" 204 0
2026-03-29 12:00:51 [auto1.nl] INFO: Found listing with ID: VU12203
2026-03-29 12:00:51 [auto1.nl] INFO: Found listing with ID: XD02824
2026-03-29 12:00:51 [auto1.nl] INFO: Found listing with ID: AA80905
2026-03-29 12:00:51 [auto1.nl] INFO: Found listing with ID: TB82163
2026-03-29 12:00:51 [auto1.nl] INFO: Found listing with ID: SY92282
2026-03-29 12:00:51 [auto1.nl] INFO: Found listing with ID: FB46775
2026-03-29 12:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FB46775%27 HTTP/1.1" 200 None
2026-03-29 12:00:51 [auto1.nl] INFO: Scrape type for FB46775: 0
2026-03-29 12:00:51 [auto1.nl] INFO: Found listing with ID: HY50584
2026-03-29 12:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HY50584%27 HTTP/1.1" 200 None
2026-03-29 12:00:51 [auto1.nl] INFO: Scrape type for HY50584: 0
2026-03-29 12:00:51 [auto1.nl] INFO: Found listing with ID: AX28541
2026-03-29 12:00:51 [auto1.nl] INFO: Found listing with ID: HK41309
2026-03-29 12:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HK41309%27 HTTP/1.1" 200 None
2026-03-29 12:00:51 [auto1.nl] INFO: Scrape type for HK41309: 2
2026-03-29 12:00:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5dc5bb30-2b38-5c98-8921-aa6df8ff1040 with identifier: HK41309
2026-03-29 12:00:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5dc5bb30-2b38-5c98-8921-aa6df8ff1040 with scrape type 2
2026-03-29 12:00:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5dc5bb30-2b38-5c98-8921-aa6df8ff1040 with scrape type 2
2026-03-29 12:00:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 5dc5bb30-2b38-5c98-8921-aa6df8ff1040, identifier: HK41309
2026-03-29 12:00:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 12:00:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 12:00:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 5dc5bb30-2b38-5c98-8921-aa6df8ff1040 with identifier: HK41309
2026-03-29 12:00:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 5dc5bb30-2b38-5c98-8921-aa6df8ff1040 with identifier: HK41309
2026-03-29 12:00:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 5dc5bb30-2b38-5c98-8921-aa6df8ff1040 with identifier: HK41309 to the API
2026-03-29 12:00:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 12:00:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 12:00:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 240,
 'expiration_date': '2026-03-30T15:40:11Z',
 'fuel_type': 'petrol',
 'id': '5dc5bb30-2b38-5c98-8921-aa6df8ff1040',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HK41309',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'S-Max',
 'odometer': 186806,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-11-25',
 'seller_name': None,
 'title': 'Ford S-Max 2.0 EcoBoost Titanium',
 'transmission': 'automatic',
 'trim': 'Titanium',
 'year': 2012}
2026-03-29 12:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HK41309%27 HTTP/1.1" 200 None
2026-03-29 12:00:51 [auto1.nl] INFO: Saving data for HK41309: {'auction_closing_time': 1774885211.0, 'created_time': 1773301820.159804, 'last_price_update_time': 1774785651.594889}
2026-03-29 12:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='HK41309') HTTP/1.1" 204 0
2026-03-29 12:00:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FF33290> (referer: https://www.auto1.com/v1/car-details-view/FF33290/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 12:00:51 [auto1.nl] INFO: Found listing with ID: KZ09082
2026-03-29 12:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KZ09082%27 HTTP/1.1" 200 None
2026-03-29 12:00:51 [auto1.nl] INFO: Scrape type for KZ09082: 0
2026-03-29 12:00:51 [auto1.nl] INFO: Found listing with ID: MP54654
2026-03-29 12:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MP54654%27 HTTP/1.1" 200 None
2026-03-29 12:00:51 [auto1.nl] INFO: Scrape type for MP54654: 0
2026-03-29 12:00:51 [auto1.nl] INFO: Found listing with ID: DD48612
2026-03-29 12:00:51 [auto1.nl] INFO: Found listing with ID: VF61988
2026-03-29 12:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VF61988%27 HTTP/1.1" 200 None
2026-03-29 12:00:51 [auto1.nl] INFO: Scrape type for VF61988: 0
2026-03-29 12:00:51 [auto1.nl] INFO: Found listing with ID: MM08239
2026-03-29 12:00:51 [auto1.nl] INFO: Found listing with ID: DE05380
2026-03-29 12:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DE05380%27 HTTP/1.1" 200 None
2026-03-29 12:00:51 [auto1.nl] INFO: Scrape type for DE05380: 0
2026-03-29 12:00:51 [auto1.nl] INFO: Found listing with ID: DM34469
2026-03-29 12:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DM34469%27 HTTP/1.1" 200 None
2026-03-29 12:00:51 [auto1.nl] INFO: Scrape type for DM34469: 0
2026-03-29 12:00:51 [auto1.nl] INFO: Found listing with ID: FL02627
2026-03-29 12:00:51 [auto1.nl] INFO: Found listing with ID: NR59954
2026-03-29 12:00:51 [auto1.nl] INFO: Found listing with ID: LC20908
2026-03-29 12:00:51 [auto1.nl] INFO: Found listing with ID: GR72952
2026-03-29 12:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GR72952%27 HTTP/1.1" 200 None
2026-03-29 12:00:51 [auto1.nl] INFO: Scrape type for GR72952: 0
2026-03-29 12:00:51 [auto1.nl] INFO: Found listing with ID: VJ06664
2026-03-29 12:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VJ06664%27 HTTP/1.1" 200 None
2026-03-29 12:00:51 [auto1.nl] INFO: Scrape type for VJ06664: 0
2026-03-29 12:00:51 [auto1.nl] INFO: Found listing with ID: ET47420
2026-03-29 12:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ET47420%27 HTTP/1.1" 200 None
2026-03-29 12:00:51 [auto1.nl] INFO: Scrape type for ET47420: 0
2026-03-29 12:00:51 [auto1.nl] INFO: Found listing with ID: KB59261
2026-03-29 12:00:51 [auto1.nl] INFO: Found listing with ID: GS47094
2026-03-29 12:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GS47094%27 HTTP/1.1" 200 None
2026-03-29 12:00:51 [auto1.nl] INFO: Scrape type for GS47094: 0
2026-03-29 12:00:51 [auto1.nl] INFO: Found listing with ID: NX76865
2026-03-29 12:00:51 [auto1.nl] INFO: Found listing with ID: MD55137
2026-03-29 12:00:51 [auto1.nl] INFO: Found listing with ID: KT95598
2026-03-29 12:00:51 [auto1.nl] INFO: Found listing with ID: JK36770
2026-03-29 12:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JK36770%27 HTTP/1.1" 200 None
2026-03-29 12:00:51 [auto1.nl] INFO: Scrape type for JK36770: 0
2026-03-29 12:00:51 [auto1.nl] INFO: Found listing with ID: ZR40703
2026-03-29 12:00:51 [auto1.nl] INFO: Found listing with ID: FP10265
2026-03-29 12:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FP10265%27 HTTP/1.1" 200 None
2026-03-29 12:00:51 [auto1.nl] INFO: Scrape type for FP10265: 0
2026-03-29 12:00:51 [auto1.nl] INFO: Found listing with ID: FY76730
2026-03-29 12:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FY76730%27 HTTP/1.1" 200 None
2026-03-29 12:00:51 [auto1.nl] INFO: Scrape type for FY76730: 0
2026-03-29 12:00:51 [auto1.nl] INFO: Found listing with ID: SY10793
2026-03-29 12:00:51 [auto1.nl] INFO: Found listing with ID: LA17019
2026-03-29 12:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LA17019%27 HTTP/1.1" 200 None
2026-03-29 12:00:51 [auto1.nl] INFO: Scrape type for LA17019: 0
2026-03-29 12:00:51 [auto1.nl] INFO: Found listing with ID: NZ11721
2026-03-29 12:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NZ11721%27 HTTP/1.1" 200 None
2026-03-29 12:00:51 [auto1.nl] INFO: Scrape type for NZ11721: 0
2026-03-29 12:00:51 [auto1.nl] INFO: Found listing with ID: LZ16255
2026-03-29 12:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LZ16255%27 HTTP/1.1" 200 None
2026-03-29 12:00:51 [auto1.nl] INFO: Scrape type for LZ16255: 0
2026-03-29 12:00:51 [auto1.nl] INFO: Found listing with ID: TF89424
2026-03-29 12:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TF89424%27 HTTP/1.1" 200 None
2026-03-29 12:00:51 [auto1.nl] INFO: Scrape type for TF89424: 0
2026-03-29 12:00:51 [auto1.nl] INFO: Found listing with ID: MZ48021
2026-03-29 12:00:51 [auto1.nl] INFO: Found listing with ID: PY50820
2026-03-29 12:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PY50820%27 HTTP/1.1" 200 None
2026-03-29 12:00:52 [auto1.nl] INFO: Scrape type for PY50820: 0
2026-03-29 12:00:52 [auto1.nl] INFO: Found listing with ID: DS36560
2026-03-29 12:00:52 [auto1.nl] INFO: Found listing with ID: RN50601
2026-03-29 12:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RN50601%27 HTTP/1.1" 200 None
2026-03-29 12:00:52 [auto1.nl] INFO: Scrape type for RN50601: 0
2026-03-29 12:00:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UG79878/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 12:00:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2e6c3d46-4e48-5f8b-9ea4-d053f83c2da8 with identifier: FF33290
2026-03-29 12:00:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2e6c3d46-4e48-5f8b-9ea4-d053f83c2da8 with scrape type 1
2026-03-29 12:00:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 2e6c3d46-4e48-5f8b-9ea4-d053f83c2da8
2026-03-29 12:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg52%252F65%252F52653828ffd652e72d0ab90713ee53fc%252Fpa%252FFF33290_996c76fac34cf16f588fc7bafe40f9d7.jpg%27 HTTP/1.1" 200 None
2026-03-29 12:00:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img52/65/52653828ffd652e72d0ab90713ee53fc/pa/FF33290_996c76fac34cf16f588fc7bafe40f9d7.jpg already downloaded
2026-03-29 12:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg52%252F65%252F52653828ffd652e72d0ab90713ee53fc%252Fpa%252FFF33290_9716c390586678f53721b15438b41f95.jpg%27 HTTP/1.1" 200 None
2026-03-29 12:00:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img52/65/52653828ffd652e72d0ab90713ee53fc/pa/FF33290_9716c390586678f53721b15438b41f95.jpg already downloaded
2026-03-29 12:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg52%252F65%252F52653828ffd652e72d0ab90713ee53fc%252Fpa%252FFF33290_e4ca6c631af64ec9fd5b55de45edf33d.jpg%27 HTTP/1.1" 200 None
2026-03-29 12:00:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img52/65/52653828ffd652e72d0ab90713ee53fc/pa/FF33290_e4ca6c631af64ec9fd5b55de45edf33d.jpg already downloaded
2026-03-29 12:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg52%252F65%252F52653828ffd652e72d0ab90713ee53fc%252Fpa%252FFF33290_373a324caacf63793afdedf01d2a7609.jpg%27 HTTP/1.1" 200 None
2026-03-29 12:00:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img52/65/52653828ffd652e72d0ab90713ee53fc/pa/FF33290_373a324caacf63793afdedf01d2a7609.jpg already downloaded
2026-03-29 12:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg52%252F65%252F52653828ffd652e72d0ab90713ee53fc%252Fpa%252FFF33290_f5a8abf0c14d8f25de926b8aa24a19cf.jpg%27 HTTP/1.1" 200 None
2026-03-29 12:00:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img52/65/52653828ffd652e72d0ab90713ee53fc/pa/FF33290_f5a8abf0c14d8f25de926b8aa24a19cf.jpg already downloaded
2026-03-29 12:00:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 2e6c3d46-4e48-5f8b-9ea4-d053f83c2da8, identifier: FF33290
2026-03-29 12:00:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 2e6c3d46-4e48-5f8b-9ea4-d053f83c2da8 with identifier: FF33290
2026-03-29 12:00:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 2e6c3d46-4e48-5f8b-9ea4-d053f83c2da8 with identifier: FF33290
2026-03-29 12:00:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 2e6c3d46-4e48-5f8b-9ea4-d053f83c2da8 with identifier: FF33290 to the API
2026-03-29 12:00:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 12:00:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 12:00:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/FF33290>
{'auction_title': '',
 'c_o_2_emission_value': 104,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 4',
 'engine': '1.6L',
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:06:29Z',
 'fuel_type': 'diesel',
 'id': '2e6c3d46-4e48-5f8b-9ea4-d053f83c2da8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': '29PJL2',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FF33290',
 'listing': 'auction',
 'location': 'NL, Den Haag',
 'make': 'MINI',
 'model': 'MINI',
 'odometer': 999999,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 5,
 'photo_urls': ['https://img-pa.auto1.com/img52/65/52653828ffd652e72d0ab90713ee53fc/pa/FF33290_996c76fac34cf16f588fc7bafe40f9d7.jpg',
                'https://img-pa.auto1.com/img52/65/52653828ffd652e72d0ab90713ee53fc/pa/FF33290_9716c390586678f53721b15438b41f95.jpg',
                'https://img-pa.auto1.com/img52/65/52653828ffd652e72d0ab90713ee53fc/pa/FF33290_e4ca6c631af64ec9fd5b55de45edf33d.jpg',
                'https://img-pa.auto1.com/img52/65/52653828ffd652e72d0ab90713ee53fc/pa/FF33290_373a324caacf63793afdedf01d2a7609.jpg',
                'https://img-pa.auto1.com/img52/65/52653828ffd652e72d0ab90713ee53fc/pa/FF33290_f5a8abf0c14d8f25de926b8aa24a19cf.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2e6c3d46-4e48-5f8b-9ea4-d053f83c2da8/2e6c3d46-4e48-5f8b-9ea4-d053f83c2da8_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 115494,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img52/65/52653828ffd652e72d0ab90713ee53fc/pa/FF33290_996c76fac34cf16f588fc7bafe40f9d7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2e6c3d46-4e48-5f8b-9ea4-d053f83c2da8/2e6c3d46-4e48-5f8b-9ea4-d053f83c2da8_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 133441,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img52/65/52653828ffd652e72d0ab90713ee53fc/pa/FF33290_9716c390586678f53721b15438b41f95.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2e6c3d46-4e48-5f8b-9ea4-d053f83c2da8/2e6c3d46-4e48-5f8b-9ea4-d053f83c2da8_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84241,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img52/65/52653828ffd652e72d0ab90713ee53fc/pa/FF33290_e4ca6c631af64ec9fd5b55de45edf33d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2e6c3d46-4e48-5f8b-9ea4-d053f83c2da8/2e6c3d46-4e48-5f8b-9ea4-d053f83c2da8_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90479,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img52/65/52653828ffd652e72d0ab90713ee53fc/pa/FF33290_373a324caacf63793afdedf01d2a7609.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2e6c3d46-4e48-5f8b-9ea4-d053f83c2da8/2e6c3d46-4e48-5f8b-9ea4-d053f83c2da8_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76049,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img52/65/52653828ffd652e72d0ab90713ee53fc/pa/FF33290_f5a8abf0c14d8f25de926b8aa24a19cf.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2008-03-20',
 'seats_number': 4,
 'seller_name': None,
 'title': 'MINI Cooper D',
 'transmission': 'manual',
 'trim': '',
 'year': 2008}
2026-03-29 12:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FF33290%27 HTTP/1.1" 200 None
2026-03-29 12:00:52 [auto1.nl] INFO: Saving data for FF33290: {'created_time': 1774785652.537312, 'last_price_update_time': 1774785652.537324, 'auction_closing_time': 1774883189.0}
2026-03-29 12:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='FF33290') HTTP/1.1" 204 0
2026-03-29 12:00:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/KH55431> (referer: https://www.auto1.com/v1/car-details-view/KH55431/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 12:00:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 12:00:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2b2d9d2b-049b-50cf-945e-4e5b9cc17501 with identifier: KH55431
2026-03-29 12:00:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2b2d9d2b-049b-50cf-945e-4e5b9cc17501 with scrape type 1
2026-03-29 12:00:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 2b2d9d2b-049b-50cf-945e-4e5b9cc17501
2026-03-29 12:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg40%252Fe1%252F40e16407750a2082018f0061ae137b1e%252Fpa%252FKH55431_26c93d2352aaff70b5844ea949deb84e.jpg%27 HTTP/1.1" 200 None
2026-03-29 12:00:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/e1/40e16407750a2082018f0061ae137b1e/pa/KH55431_26c93d2352aaff70b5844ea949deb84e.jpg already downloaded
2026-03-29 12:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg40%252Fe1%252F40e16407750a2082018f0061ae137b1e%252Fpa%252FKH55431_08a6c762aa398eedb55d7d8ebd59d0fe.jpg%27 HTTP/1.1" 200 None
2026-03-29 12:00:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/e1/40e16407750a2082018f0061ae137b1e/pa/KH55431_08a6c762aa398eedb55d7d8ebd59d0fe.jpg already downloaded
2026-03-29 12:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg40%252Fe1%252F40e16407750a2082018f0061ae137b1e%252Fpa%252FKH55431_7e0ccdcc9b4ffbdb499b46eb4337d94a.jpg%27 HTTP/1.1" 200 None
2026-03-29 12:00:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/e1/40e16407750a2082018f0061ae137b1e/pa/KH55431_7e0ccdcc9b4ffbdb499b46eb4337d94a.jpg already downloaded
2026-03-29 12:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg40%252Fe1%252F40e16407750a2082018f0061ae137b1e%252Fpa%252FKH55431_001cafb6be143203843300ddd9fc3cde.jpg%27 HTTP/1.1" 200 None
2026-03-29 12:00:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/e1/40e16407750a2082018f0061ae137b1e/pa/KH55431_001cafb6be143203843300ddd9fc3cde.jpg already downloaded
2026-03-29 12:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg40%252Fe1%252F40e16407750a2082018f0061ae137b1e%252Fpa%252FKH55431_ea601b5ce3d36bf2331772d98c903ce9.jpg%27 HTTP/1.1" 200 None
2026-03-29 12:00:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img40/e1/40e16407750a2082018f0061ae137b1e/pa/KH55431_ea601b5ce3d36bf2331772d98c903ce9.jpg already downloaded
2026-03-29 12:00:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 2b2d9d2b-049b-50cf-945e-4e5b9cc17501, identifier: KH55431
2026-03-29 12:00:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 2b2d9d2b-049b-50cf-945e-4e5b9cc17501 with identifier: KH55431
2026-03-29 12:00:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 2b2d9d2b-049b-50cf-945e-4e5b9cc17501 with identifier: KH55431
2026-03-29 12:00:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 2b2d9d2b-049b-50cf-945e-4e5b9cc17501 with identifier: KH55431 to the API
2026-03-29 12:00:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 12:00:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 12:00:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/KH55431>
{'auction_title': '',
 'c_o_2_emission_value': 190,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '2.0L',
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:18:39Z',
 'fuel_type': 'petrol',
 'id': '2b2d9d2b-049b-50cf-945e-4e5b9cc17501',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': '34HNB6',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KH55431',
 'listing': 'auction',
 'location': 'NL, Venlo',
 'make': 'Citroen',
 'model': 'C4 Grand Picasso',
 'odometer': 233013,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 5,
 'photo_urls': ['https://img-pa.auto1.com/img40/e1/40e16407750a2082018f0061ae137b1e/pa/KH55431_26c93d2352aaff70b5844ea949deb84e.jpg',
                'https://img-pa.auto1.com/img40/e1/40e16407750a2082018f0061ae137b1e/pa/KH55431_08a6c762aa398eedb55d7d8ebd59d0fe.jpg',
                'https://img-pa.auto1.com/img40/e1/40e16407750a2082018f0061ae137b1e/pa/KH55431_7e0ccdcc9b4ffbdb499b46eb4337d94a.jpg',
                'https://img-pa.auto1.com/img40/e1/40e16407750a2082018f0061ae137b1e/pa/KH55431_001cafb6be143203843300ddd9fc3cde.jpg',
                'https://img-pa.auto1.com/img40/e1/40e16407750a2082018f0061ae137b1e/pa/KH55431_ea601b5ce3d36bf2331772d98c903ce9.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2b2d9d2b-049b-50cf-945e-4e5b9cc17501/2b2d9d2b-049b-50cf-945e-4e5b9cc17501_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 101796,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img40/e1/40e16407750a2082018f0061ae137b1e/pa/KH55431_26c93d2352aaff70b5844ea949deb84e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2b2d9d2b-049b-50cf-945e-4e5b9cc17501/2b2d9d2b-049b-50cf-945e-4e5b9cc17501_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91973,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img40/e1/40e16407750a2082018f0061ae137b1e/pa/KH55431_08a6c762aa398eedb55d7d8ebd59d0fe.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2b2d9d2b-049b-50cf-945e-4e5b9cc17501/2b2d9d2b-049b-50cf-945e-4e5b9cc17501_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85852,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img40/e1/40e16407750a2082018f0061ae137b1e/pa/KH55431_7e0ccdcc9b4ffbdb499b46eb4337d94a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2b2d9d2b-049b-50cf-945e-4e5b9cc17501/2b2d9d2b-049b-50cf-945e-4e5b9cc17501_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71892,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img40/e1/40e16407750a2082018f0061ae137b1e/pa/KH55431_001cafb6be143203843300ddd9fc3cde.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2b2d9d2b-049b-50cf-945e-4e5b9cc17501/2b2d9d2b-049b-50cf-945e-4e5b9cc17501_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75605,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img40/e1/40e16407750a2082018f0061ae137b1e/pa/KH55431_ea601b5ce3d36bf2331772d98c903ce9.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2009-01-07',
 'seats_number': 7,
 'seller_name': None,
 'title': 'Citroen C4 Grand Picasso 2.0 Ambiance',
 'transmission': 'automatic',
 'trim': 'Ambiance',
 'year': 2009}
2026-03-29 12:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KH55431%27 HTTP/1.1" 200 None
2026-03-29 12:00:53 [auto1.nl] INFO: Saving data for KH55431: {'created_time': 1774785653.315084, 'last_price_update_time': 1774785653.315094, 'auction_closing_time': 1774883919.0}
2026-03-29 12:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='KH55431') HTTP/1.1" 204 0
2026-03-29 12:00:53 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 12:00:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/MB43165> (referer: https://www.auto1.com/v1/car-details-view/MB43165/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 12:00:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TT87192/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 12:00:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UE71777> (referer: https://www.auto1.com/v1/car-details-view/UE71777/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 12:00:53 [auto1.nl] INFO: Channel: 24h | Page: 6 | totalHits: 759 | hits on page: 40
2026-03-29 12:00:53 [auto1.nl] INFO: Found listing with ID: YN14337
2026-03-29 12:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YN14337%27 HTTP/1.1" 200 None
2026-03-29 12:00:53 [auto1.nl] INFO: Scrape type for YN14337: 0
2026-03-29 12:00:53 [auto1.nl] INFO: Found listing with ID: UD40907
2026-03-29 12:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UD40907%27 HTTP/1.1" 200 None
2026-03-29 12:00:53 [auto1.nl] INFO: Scrape type for UD40907: 0
2026-03-29 12:00:53 [auto1.nl] INFO: Found listing with ID: LN13615
2026-03-29 12:00:53 [auto1.nl] INFO: Found listing with ID: MB44193
2026-03-29 12:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MB44193%27 HTTP/1.1" 200 None
2026-03-29 12:00:53 [auto1.nl] INFO: Scrape type for MB44193: 0
2026-03-29 12:00:53 [auto1.nl] INFO: Found listing with ID: LG57021
2026-03-29 12:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LG57021%27 HTTP/1.1" 200 None
2026-03-29 12:00:53 [auto1.nl] INFO: Scrape type for LG57021: 0
2026-03-29 12:00:53 [auto1.nl] INFO: Found listing with ID: NZ51488
2026-03-29 12:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NZ51488%27 HTTP/1.1" 200 None
2026-03-29 12:00:53 [auto1.nl] INFO: Scrape type for NZ51488: 0
2026-03-29 12:00:53 [auto1.nl] INFO: Found listing with ID: EK85406
2026-03-29 12:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EK85406%27 HTTP/1.1" 200 None
2026-03-29 12:00:53 [auto1.nl] INFO: Scrape type for EK85406: 0
2026-03-29 12:00:53 [auto1.nl] INFO: Found listing with ID: RC74760
2026-03-29 12:00:53 [auto1.nl] INFO: Found listing with ID: BW31181
2026-03-29 12:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BW31181%27 HTTP/1.1" 200 None
2026-03-29 12:00:53 [auto1.nl] INFO: Scrape type for BW31181: 0
2026-03-29 12:00:53 [auto1.nl] INFO: Found listing with ID: VM45476
2026-03-29 12:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VM45476%27 HTTP/1.1" 200 None
2026-03-29 12:00:53 [auto1.nl] INFO: Scrape type for VM45476: 0
2026-03-29 12:00:53 [auto1.nl] INFO: Found listing with ID: KA53212
2026-03-29 12:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KA53212%27 HTTP/1.1" 200 None
2026-03-29 12:00:53 [auto1.nl] INFO: Scrape type for KA53212: 0
2026-03-29 12:00:53 [auto1.nl] INFO: Found listing with ID: VL07732
2026-03-29 12:00:53 [auto1.nl] INFO: Found listing with ID: RX80263
2026-03-29 12:00:53 [auto1.nl] INFO: Found listing with ID: GL59810
2026-03-29 12:00:53 [auto1.nl] INFO: Found listing with ID: DG66253
2026-03-29 12:00:53 [auto1.nl] INFO: Found listing with ID: CF65603
2026-03-29 12:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CF65603%27 HTTP/1.1" 200 None
2026-03-29 12:00:53 [auto1.nl] INFO: Scrape type for CF65603: 0
2026-03-29 12:00:53 [auto1.nl] INFO: Found listing with ID: GD99184
2026-03-29 12:00:53 [auto1.nl] INFO: Found listing with ID: FD12318
2026-03-29 12:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FD12318%27 HTTP/1.1" 200 None
2026-03-29 12:00:53 [auto1.nl] INFO: Scrape type for FD12318: 0
2026-03-29 12:00:53 [auto1.nl] INFO: Found listing with ID: RT28324
2026-03-29 12:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RT28324%27 HTTP/1.1" 200 None
2026-03-29 12:00:53 [auto1.nl] INFO: Scrape type for RT28324: 0
2026-03-29 12:00:53 [auto1.nl] INFO: Found listing with ID: ZP12059
2026-03-29 12:00:53 [auto1.nl] INFO: Found listing with ID: ML63258
2026-03-29 12:00:53 [auto1.nl] INFO: Found listing with ID: RA23366
2026-03-29 12:00:53 [auto1.nl] INFO: Found listing with ID: NX47084
2026-03-29 12:00:53 [auto1.nl] INFO: Found listing with ID: JR89598
2026-03-29 12:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JR89598%27 HTTP/1.1" 200 None
2026-03-29 12:00:53 [auto1.nl] INFO: Scrape type for JR89598: 0
2026-03-29 12:00:53 [auto1.nl] INFO: Found listing with ID: EY85081
2026-03-29 12:00:53 [auto1.nl] INFO: Found listing with ID: MW16655
2026-03-29 12:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MW16655%27 HTTP/1.1" 200 None
2026-03-29 12:00:53 [auto1.nl] INFO: Scrape type for MW16655: 0
2026-03-29 12:00:53 [auto1.nl] INFO: Found listing with ID: XY67301
2026-03-29 12:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XY67301%27 HTTP/1.1" 200 None
2026-03-29 12:00:53 [auto1.nl] INFO: Scrape type for XY67301: 0
2026-03-29 12:00:53 [auto1.nl] INFO: Found listing with ID: ET49040
2026-03-29 12:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ET49040%27 HTTP/1.1" 200 None
2026-03-29 12:00:53 [auto1.nl] INFO: Scrape type for ET49040: 0
2026-03-29 12:00:53 [auto1.nl] INFO: Found listing with ID: AC84495
2026-03-29 12:00:53 [auto1.nl] INFO: Found listing with ID: WV54622
2026-03-29 12:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WV54622%27 HTTP/1.1" 200 None
2026-03-29 12:00:53 [auto1.nl] INFO: Scrape type for WV54622: 0
2026-03-29 12:00:53 [auto1.nl] INFO: Found listing with ID: TN92622
2026-03-29 12:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TN92622%27 HTTP/1.1" 200 None
2026-03-29 12:00:53 [auto1.nl] INFO: Scrape type for TN92622: 0
2026-03-29 12:00:53 [auto1.nl] INFO: Found listing with ID: FK48987
2026-03-29 12:00:53 [auto1.nl] INFO: Found listing with ID: PM71197
2026-03-29 12:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PM71197%27 HTTP/1.1" 200 None
2026-03-29 12:00:53 [auto1.nl] INFO: Scrape type for PM71197: 0
2026-03-29 12:00:53 [auto1.nl] INFO: Found listing with ID: MD18353
2026-03-29 12:00:53 [auto1.nl] INFO: Found listing with ID: FP18275
2026-03-29 12:00:53 [auto1.nl] INFO: Found listing with ID: BV58634
2026-03-29 12:00:53 [auto1.nl] INFO: Found listing with ID: SE99372
2026-03-29 12:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SE99372%27 HTTP/1.1" 200 None
2026-03-29 12:00:53 [auto1.nl] INFO: Scrape type for SE99372: 0
2026-03-29 12:00:53 [auto1.nl] INFO: Found listing with ID: JM47469
2026-03-29 12:00:53 [auto1.nl] INFO: Found listing with ID: FL63517
2026-03-29 12:00:53 [auto1.nl] INFO: Found listing with ID: BM96536
2026-03-29 12:00:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 12:00:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2b9d4aa4-afb0-5498-bbf7-0efe1853157b with identifier: MB43165
2026-03-29 12:00:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2b9d4aa4-afb0-5498-bbf7-0efe1853157b with scrape type 1
2026-03-29 12:00:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 2b9d4aa4-afb0-5498-bbf7-0efe1853157b
2026-03-29 12:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252F73%252Fdf73a325ece8c7dca5f20e0081e38de2%252Fpa%252FMB43165_02a9fac90d005e2617299c11c2c5728a.jpg%27 HTTP/1.1" 200 None
2026-03-29 12:00:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/73/df73a325ece8c7dca5f20e0081e38de2/pa/MB43165_02a9fac90d005e2617299c11c2c5728a.jpg already downloaded
2026-03-29 12:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252F73%252Fdf73a325ece8c7dca5f20e0081e38de2%252Fpa%252FMB43165_f55f7800d7ee2088a9511bfc734577f7.jpg%27 HTTP/1.1" 200 None
2026-03-29 12:00:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/73/df73a325ece8c7dca5f20e0081e38de2/pa/MB43165_f55f7800d7ee2088a9511bfc734577f7.jpg already downloaded
2026-03-29 12:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252F73%252Fdf73a325ece8c7dca5f20e0081e38de2%252Fpa%252FMB43165_9e6b40d337bc0188f4a023a7630fd8cd.jpg%27 HTTP/1.1" 200 None
2026-03-29 12:00:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/73/df73a325ece8c7dca5f20e0081e38de2/pa/MB43165_9e6b40d337bc0188f4a023a7630fd8cd.jpg already downloaded
2026-03-29 12:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252F73%252Fdf73a325ece8c7dca5f20e0081e38de2%252Fpa%252FMB43165_1dad6deef63610ffe5fb587c7bf9b5ae.jpg%27 HTTP/1.1" 200 None
2026-03-29 12:00:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/73/df73a325ece8c7dca5f20e0081e38de2/pa/MB43165_1dad6deef63610ffe5fb587c7bf9b5ae.jpg already downloaded
2026-03-29 12:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252F73%252Fdf73a325ece8c7dca5f20e0081e38de2%252Fpa%252FMB43165_05460118029bfec149b2567ceedf2f9a.jpg%27 HTTP/1.1" 200 None
2026-03-29 12:00:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/73/df73a325ece8c7dca5f20e0081e38de2/pa/MB43165_05460118029bfec149b2567ceedf2f9a.jpg already downloaded
2026-03-29 12:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252F73%252Fdf73a325ece8c7dca5f20e0081e38de2%252Fpa%252FMB43165_3fc41cc1e0763a1ab82e7ad512c5f5bf.jpg%27 HTTP/1.1" 200 None
2026-03-29 12:00:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/73/df73a325ece8c7dca5f20e0081e38de2/pa/MB43165_3fc41cc1e0763a1ab82e7ad512c5f5bf.jpg already downloaded
2026-03-29 12:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252F73%252Fdf73a325ece8c7dca5f20e0081e38de2%252Fpa%252FMB43165_7912f3fce8179347c77751dcc7f6e469.jpg%27 HTTP/1.1" 200 None
2026-03-29 12:00:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/73/df73a325ece8c7dca5f20e0081e38de2/pa/MB43165_7912f3fce8179347c77751dcc7f6e469.jpg already downloaded
2026-03-29 12:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252F73%252Fdf73a325ece8c7dca5f20e0081e38de2%252Fpa%252FMB43165_3933147b18f9040ca3657af182625abc.jpg%27 HTTP/1.1" 200 None
2026-03-29 12:00:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/73/df73a325ece8c7dca5f20e0081e38de2/pa/MB43165_3933147b18f9040ca3657af182625abc.jpg already downloaded
2026-03-29 12:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252F73%252Fdf73a325ece8c7dca5f20e0081e38de2%252Fpa%252FMB43165_fd15d6fb3d52277facaf8e2d96d7eaa3.jpg%27 HTTP/1.1" 200 None
2026-03-29 12:00:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/73/df73a325ece8c7dca5f20e0081e38de2/pa/MB43165_fd15d6fb3d52277facaf8e2d96d7eaa3.jpg already downloaded
2026-03-29 12:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgdf%252F73%252Fdf73a325ece8c7dca5f20e0081e38de2%252Fpa%252FMB43165_10b7a5a4fdde1a6fb7125f842a580f24.jpg%27 HTTP/1.1" 200 None
2026-03-29 12:00:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgdf/73/df73a325ece8c7dca5f20e0081e38de2/pa/MB43165_10b7a5a4fdde1a6fb7125f842a580f24.jpg already downloaded
2026-03-29 12:00:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 2b9d4aa4-afb0-5498-bbf7-0efe1853157b, identifier: MB43165
2026-03-29 12:00:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 2b9d4aa4-afb0-5498-bbf7-0efe1853157b with identifier: MB43165
2026-03-29 12:00:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 2b9d4aa4-afb0-5498-bbf7-0efe1853157b with identifier: MB43165
2026-03-29 12:00:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 2b9d4aa4-afb0-5498-bbf7-0efe1853157b with identifier: MB43165 to the API
2026-03-29 12:00:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 12:00:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 12:00:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/MB43165>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.3L',
 'engine_horse_power': 163,
 'expiration_date': '2026-03-30T15:26:15Z',
 'fuel_type': 'petrol',
 'id': '2b9d4aa4-afb0-5498-bbf7-0efe1853157b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MB43165',
 'listing': 'auction',
 'location': 'NL, Oosterhout',
 'make': 'Mercedes-Benz',
 'model': 'CLA-Klasse',
 'odometer': 57566,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 14,
 'photo_urls': ['https://img-pa.auto1.com/imgdf/73/df73a325ece8c7dca5f20e0081e38de2/pa/MB43165_02a9fac90d005e2617299c11c2c5728a.jpg',
                'https://img-pa.auto1.com/imgdf/73/df73a325ece8c7dca5f20e0081e38de2/pa/MB43165_f55f7800d7ee2088a9511bfc734577f7.jpg',
                'https://img-pa.auto1.com/imgdf/73/df73a325ece8c7dca5f20e0081e38de2/pa/MB43165_9e6b40d337bc0188f4a023a7630fd8cd.jpg',
                'https://img-pa.auto1.com/imgdf/73/df73a325ece8c7dca5f20e0081e38de2/pa/MB43165_1dad6deef63610ffe5fb587c7bf9b5ae.jpg',
                'https://img-pa.auto1.com/imgdf/73/df73a325ece8c7dca5f20e0081e38de2/pa/MB43165_05460118029bfec149b2567ceedf2f9a.jpg',
                'https://img-pa.auto1.com/imgdf/73/df73a325ece8c7dca5f20e0081e38de2/pa/MB43165_3fc41cc1e0763a1ab82e7ad512c5f5bf.jpg',
                'https://img-pa.auto1.com/imgdf/73/df73a325ece8c7dca5f20e0081e38de2/pa/MB43165_7912f3fce8179347c77751dcc7f6e469.jpg',
                'https://img-pa.auto1.com/imgdf/73/df73a325ece8c7dca5f20e0081e38de2/pa/MB43165_3933147b18f9040ca3657af182625abc.jpg',
                'https://img-pa.auto1.com/imgdf/73/df73a325ece8c7dca5f20e0081e38de2/pa/MB43165_fd15d6fb3d52277facaf8e2d96d7eaa3.jpg',
                'https://img-pa.auto1.com/imgdf/73/df73a325ece8c7dca5f20e0081e38de2/pa/MB43165_10b7a5a4fdde1a6fb7125f842a580f24.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2b9d4aa4-afb0-5498-bbf7-0efe1853157b/2b9d4aa4-afb0-5498-bbf7-0efe1853157b_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 94584,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdf/73/df73a325ece8c7dca5f20e0081e38de2/pa/MB43165_02a9fac90d005e2617299c11c2c5728a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2b9d4aa4-afb0-5498-bbf7-0efe1853157b/2b9d4aa4-afb0-5498-bbf7-0efe1853157b_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92918,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdf/73/df73a325ece8c7dca5f20e0081e38de2/pa/MB43165_f55f7800d7ee2088a9511bfc734577f7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2b9d4aa4-afb0-5498-bbf7-0efe1853157b/2b9d4aa4-afb0-5498-bbf7-0efe1853157b_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87019,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdf/73/df73a325ece8c7dca5f20e0081e38de2/pa/MB43165_9e6b40d337bc0188f4a023a7630fd8cd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2b9d4aa4-afb0-5498-bbf7-0efe1853157b/2b9d4aa4-afb0-5498-bbf7-0efe1853157b_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79213,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdf/73/df73a325ece8c7dca5f20e0081e38de2/pa/MB43165_1dad6deef63610ffe5fb587c7bf9b5ae.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2b9d4aa4-afb0-5498-bbf7-0efe1853157b/2b9d4aa4-afb0-5498-bbf7-0efe1853157b_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82325,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdf/73/df73a325ece8c7dca5f20e0081e38de2/pa/MB43165_05460118029bfec149b2567ceedf2f9a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2b9d4aa4-afb0-5498-bbf7-0efe1853157b/2b9d4aa4-afb0-5498-bbf7-0efe1853157b_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91927,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdf/73/df73a325ece8c7dca5f20e0081e38de2/pa/MB43165_3fc41cc1e0763a1ab82e7ad512c5f5bf.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2b9d4aa4-afb0-5498-bbf7-0efe1853157b/2b9d4aa4-afb0-5498-bbf7-0efe1853157b_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80291,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdf/73/df73a325ece8c7dca5f20e0081e38de2/pa/MB43165_7912f3fce8179347c77751dcc7f6e469.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2b9d4aa4-afb0-5498-bbf7-0efe1853157b/2b9d4aa4-afb0-5498-bbf7-0efe1853157b_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 99599,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdf/73/df73a325ece8c7dca5f20e0081e38de2/pa/MB43165_3933147b18f9040ca3657af182625abc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2b9d4aa4-afb0-5498-bbf7-0efe1853157b/2b9d4aa4-afb0-5498-bbf7-0efe1853157b_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87997,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdf/73/df73a325ece8c7dca5f20e0081e38de2/pa/MB43165_fd15d6fb3d52277facaf8e2d96d7eaa3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2b9d4aa4-afb0-5498-bbf7-0efe1853157b/2b9d4aa4-afb0-5498-bbf7-0efe1853157b_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69767,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgdf/73/df73a325ece8c7dca5f20e0081e38de2/pa/MB43165_10b7a5a4fdde1a6fb7125f842a580f24.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2021-01-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz CLA-Klasse CLA 200 Shooting Brake AMG Line',
 'transmission': 'automatic',
 'trim': 'AMG Line',
 'year': 2021}
2026-03-29 12:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MB43165%27 HTTP/1.1" 200 None
2026-03-29 12:00:54 [auto1.nl] INFO: Saving data for MB43165: {'created_time': 1774785654.542801, 'last_price_update_time': 1774785654.542813, 'auction_closing_time': 1774884375.0}
2026-03-29 12:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='MB43165') HTTP/1.1" 204 0
2026-03-29 12:00:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 524ccbfd-57ae-56a8-8b00-607964da462e with identifier: UE71777
2026-03-29 12:00:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 524ccbfd-57ae-56a8-8b00-607964da462e with scrape type 1
2026-03-29 12:00:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 524ccbfd-57ae-56a8-8b00-607964da462e
2026-03-29 12:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd5%252F33%252Fd5336b07be198360fa2654c542c874e6%252Fpa%252FUE71777_b8321c21711606d394316c6f0cba8070.jpg%27 HTTP/1.1" 200 None
2026-03-29 12:00:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/33/d5336b07be198360fa2654c542c874e6/pa/UE71777_b8321c21711606d394316c6f0cba8070.jpg already downloaded
2026-03-29 12:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd5%252F33%252Fd5336b07be198360fa2654c542c874e6%252Fpa%252FUE71777_8022570428ddfb4514d87ee315222bb4.jpg%27 HTTP/1.1" 200 None
2026-03-29 12:00:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/33/d5336b07be198360fa2654c542c874e6/pa/UE71777_8022570428ddfb4514d87ee315222bb4.jpg already downloaded
2026-03-29 12:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd5%252F33%252Fd5336b07be198360fa2654c542c874e6%252Fpa%252FUE71777_b05cba79d33cd84139f138e224286c37.jpg%27 HTTP/1.1" 200 None
2026-03-29 12:00:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/33/d5336b07be198360fa2654c542c874e6/pa/UE71777_b05cba79d33cd84139f138e224286c37.jpg already downloaded
2026-03-29 12:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd5%252F33%252Fd5336b07be198360fa2654c542c874e6%252Fpa%252FUE71777_5ef974d964b196f82544c4c8b5c8307a.jpg%27 HTTP/1.1" 200 None
2026-03-29 12:00:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/33/d5336b07be198360fa2654c542c874e6/pa/UE71777_5ef974d964b196f82544c4c8b5c8307a.jpg already downloaded
2026-03-29 12:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd5%252F33%252Fd5336b07be198360fa2654c542c874e6%252Fpa%252FUE71777_28f5f5da6c0052f6531c9f8b08945783.jpg%27 HTTP/1.1" 200 None
2026-03-29 12:00:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd5/33/d5336b07be198360fa2654c542c874e6/pa/UE71777_28f5f5da6c0052f6531c9f8b08945783.jpg already downloaded
2026-03-29 12:00:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 524ccbfd-57ae-56a8-8b00-607964da462e, identifier: UE71777
2026-03-29 12:00:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 524ccbfd-57ae-56a8-8b00-607964da462e with identifier: UE71777
2026-03-29 12:00:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 524ccbfd-57ae-56a8-8b00-607964da462e with identifier: UE71777
2026-03-29 12:00:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 524ccbfd-57ae-56a8-8b00-607964da462e with identifier: UE71777 to the API
2026-03-29 12:00:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 12:00:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 12:00:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/UE71777>
{'auction_title': '',
 'c_o_2_emission_value': 155,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 3',
 'engine': '1.6L',
 'engine_horse_power': 110,
 'expiration_date': '2026-03-30T15:32:50Z',
 'fuel_type': 'petrol',
 'id': '524ccbfd-57ae-56a8-8b00-607964da462e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': '14JRDS',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UE71777',
 'listing': 'auction',
 'location': 'NL, Oosterhout',
 'make': 'Citroen',
 'model': 'C3',
 'odometer': 167198,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 5,
 'photo_urls': ['https://img-pa.auto1.com/imgd5/33/d5336b07be198360fa2654c542c874e6/pa/UE71777_b8321c21711606d394316c6f0cba8070.jpg',
                'https://img-pa.auto1.com/imgd5/33/d5336b07be198360fa2654c542c874e6/pa/UE71777_8022570428ddfb4514d87ee315222bb4.jpg',
                'https://img-pa.auto1.com/imgd5/33/d5336b07be198360fa2654c542c874e6/pa/UE71777_b05cba79d33cd84139f138e224286c37.jpg',
                'https://img-pa.auto1.com/imgd5/33/d5336b07be198360fa2654c542c874e6/pa/UE71777_5ef974d964b196f82544c4c8b5c8307a.jpg',
                'https://img-pa.auto1.com/imgd5/33/d5336b07be198360fa2654c542c874e6/pa/UE71777_28f5f5da6c0052f6531c9f8b08945783.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_524ccbfd-57ae-56a8-8b00-607964da462e/524ccbfd-57ae-56a8-8b00-607964da462e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 112135,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd5/33/d5336b07be198360fa2654c542c874e6/pa/UE71777_b8321c21711606d394316c6f0cba8070.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_524ccbfd-57ae-56a8-8b00-607964da462e/524ccbfd-57ae-56a8-8b00-607964da462e_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 95973,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd5/33/d5336b07be198360fa2654c542c874e6/pa/UE71777_8022570428ddfb4514d87ee315222bb4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_524ccbfd-57ae-56a8-8b00-607964da462e/524ccbfd-57ae-56a8-8b00-607964da462e_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86039,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd5/33/d5336b07be198360fa2654c542c874e6/pa/UE71777_b05cba79d33cd84139f138e224286c37.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_524ccbfd-57ae-56a8-8b00-607964da462e/524ccbfd-57ae-56a8-8b00-607964da462e_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76477,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd5/33/d5336b07be198360fa2654c542c874e6/pa/UE71777_5ef974d964b196f82544c4c8b5c8307a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_524ccbfd-57ae-56a8-8b00-607964da462e/524ccbfd-57ae-56a8-8b00-607964da462e_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62106,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd5/33/d5336b07be198360fa2654c542c874e6/pa/UE71777_28f5f5da6c0052f6531c9f8b08945783.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2002-07-14',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Citroen C3 1.6 Exclusive SensoDrive',
 'transmission': 'automatic',
 'trim': 'Exclusive SensoDrive',
 'year': 2002}
2026-03-29 12:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UE71777%27 HTTP/1.1" 200 None
2026-03-29 12:00:55 [auto1.nl] INFO: Saving data for UE71777: {'created_time': 1774785655.335693, 'last_price_update_time': 1774785655.335706, 'auction_closing_time': 1774884770.0}
2026-03-29 12:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='UE71777') HTTP/1.1" 204 0
2026-03-29 12:00:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 12:00:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UG79878> (referer: https://www.auto1.com/v1/car-details-view/UG79878/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 12:00:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 79bc33e2-6592-5230-9735-db03c5432de8 with identifier: UG79878
2026-03-29 12:00:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 79bc33e2-6592-5230-9735-db03c5432de8 with scrape type 1
2026-03-29 12:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 4 photos for item 79bc33e2-6592-5230-9735-db03c5432de8
2026-03-29 12:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg19%252F71%252F1971e2f4fda4274d8d914a94961f1e1e%252Fpa%252FUG79878_f60ee07e2444899f709daea90cf2693d.jpg%27 HTTP/1.1" 200 None
2026-03-29 12:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/71/1971e2f4fda4274d8d914a94961f1e1e/pa/UG79878_f60ee07e2444899f709daea90cf2693d.jpg already downloaded
2026-03-29 12:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg19%252F71%252F1971e2f4fda4274d8d914a94961f1e1e%252Fpa%252FUG79878_d2e3774a2f2ba71e52c2fc526e049f1c.jpg%27 HTTP/1.1" 200 None
2026-03-29 12:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/71/1971e2f4fda4274d8d914a94961f1e1e/pa/UG79878_d2e3774a2f2ba71e52c2fc526e049f1c.jpg already downloaded
2026-03-29 12:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg19%252F71%252F1971e2f4fda4274d8d914a94961f1e1e%252Fpa%252FUG79878_fdafd576dfbab6ee2d2be0dc9be13ffa.jpg%27 HTTP/1.1" 200 None
2026-03-29 12:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/71/1971e2f4fda4274d8d914a94961f1e1e/pa/UG79878_fdafd576dfbab6ee2d2be0dc9be13ffa.jpg already downloaded
2026-03-29 12:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg19%252F71%252F1971e2f4fda4274d8d914a94961f1e1e%252Fpa%252FUG79878_24d51b8e97534bf82879a75dfc71a653.jpg%27 HTTP/1.1" 200 None
2026-03-29 12:00:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img19/71/1971e2f4fda4274d8d914a94961f1e1e/pa/UG79878_24d51b8e97534bf82879a75dfc71a653.jpg already downloaded
2026-03-29 12:00:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 79bc33e2-6592-5230-9735-db03c5432de8, identifier: UG79878
2026-03-29 12:00:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 79bc33e2-6592-5230-9735-db03c5432de8 with identifier: UG79878
2026-03-29 12:00:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 12:00:55 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=yellow HTTP/1.1" 200 None
2026-03-29 12:00:55 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 12:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 12:00:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 79bc33e2-6592-5230-9735-db03c5432de8 with identifier: UG79878
2026-03-29 12:00:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 79bc33e2-6592-5230-9735-db03c5432de8 with identifier: UG79878 to the API
2026-03-29 12:00:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 12:00:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 12:00:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/UG79878>
{'auction_title': '',
 'c_o_2_emission_value': 191,
 'category': None,
 'color': 'yellow',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '1.6L',
 'engine_horse_power': 105,
 'expiration_date': '2026-03-30T15:11:06Z',
 'fuel_type': 'petrol',
 'id': '79bc33e2-6592-5230-9735-db03c5432de8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': '61HRS3',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UG79878',
 'listing': 'auction',
 'location': 'NL, Venlo',
 'make': 'Renault',
 'model': 'Kangoo',
 'odometer': 397546,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 4,
 'photo_urls': ['https://img-pa.auto1.com/img19/71/1971e2f4fda4274d8d914a94961f1e1e/pa/UG79878_f60ee07e2444899f709daea90cf2693d.jpg',
                'https://img-pa.auto1.com/img19/71/1971e2f4fda4274d8d914a94961f1e1e/pa/UG79878_d2e3774a2f2ba71e52c2fc526e049f1c.jpg',
                'https://img-pa.auto1.com/img19/71/1971e2f4fda4274d8d914a94961f1e1e/pa/UG79878_fdafd576dfbab6ee2d2be0dc9be13ffa.jpg',
                'https://img-pa.auto1.com/img19/71/1971e2f4fda4274d8d914a94961f1e1e/pa/UG79878_24d51b8e97534bf82879a75dfc71a653.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79bc33e2-6592-5230-9735-db03c5432de8/79bc33e2-6592-5230-9735-db03c5432de8_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69279,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img19/71/1971e2f4fda4274d8d914a94961f1e1e/pa/UG79878_f60ee07e2444899f709daea90cf2693d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79bc33e2-6592-5230-9735-db03c5432de8/79bc33e2-6592-5230-9735-db03c5432de8_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74257,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img19/71/1971e2f4fda4274d8d914a94961f1e1e/pa/UG79878_d2e3774a2f2ba71e52c2fc526e049f1c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79bc33e2-6592-5230-9735-db03c5432de8/79bc33e2-6592-5230-9735-db03c5432de8_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73718,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img19/71/1971e2f4fda4274d8d914a94961f1e1e/pa/UG79878_fdafd576dfbab6ee2d2be0dc9be13ffa.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79bc33e2-6592-5230-9735-db03c5432de8/79bc33e2-6592-5230-9735-db03c5432de8_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61013,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img19/71/1971e2f4fda4274d8d914a94961f1e1e/pa/UG79878_24d51b8e97534bf82879a75dfc71a653.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2009-02-09',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Renault Kangoo 1.6 Privilege',
 'transmission': 'manual',
 'trim': 'Privilege',
 'year': 2009}
2026-03-29 12:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UG79878%27 HTTP/1.1" 200 None
2026-03-29 12:00:56 [auto1.nl] INFO: Saving data for UG79878: {'created_time': 1774785656.264198, 'last_price_update_time': 1774785656.26421, 'auction_closing_time': 1774883466.0}
2026-03-29 12:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='UG79878') HTTP/1.1" 204 0
2026-03-29 12:00:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TT87192> (referer: https://www.auto1.com/v1/car-details-view/TT87192/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 12:00:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8adabe83-0ddc-567b-9799-ad5b268c02a3 with identifier: TT87192
2026-03-29 12:00:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8adabe83-0ddc-567b-9799-ad5b268c02a3 with scrape type 1
2026-03-29 12:00:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 8adabe83-0ddc-567b-9799-ad5b268c02a3
2026-03-29 12:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252F2a%252Fc32a34b6b27f4bd19cf1729b4d7c693c%252Fpa%252FTT87192_cf7449a457591e8df0d448e2b25e6936.jpg%27 HTTP/1.1" 200 None
2026-03-29 12:00:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/2a/c32a34b6b27f4bd19cf1729b4d7c693c/pa/TT87192_cf7449a457591e8df0d448e2b25e6936.jpg already downloaded
2026-03-29 12:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252F2a%252Fc32a34b6b27f4bd19cf1729b4d7c693c%252Fpa%252FTT87192_a0034fee5c2db038ccdebfeb631376a0.jpg%27 HTTP/1.1" 200 None
2026-03-29 12:00:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/2a/c32a34b6b27f4bd19cf1729b4d7c693c/pa/TT87192_a0034fee5c2db038ccdebfeb631376a0.jpg already downloaded
2026-03-29 12:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252F2a%252Fc32a34b6b27f4bd19cf1729b4d7c693c%252Fpa%252FTT87192_d1b58c6e3e5409c767be86f6073de7e2.jpg%27 HTTP/1.1" 200 None
2026-03-29 12:00:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/2a/c32a34b6b27f4bd19cf1729b4d7c693c/pa/TT87192_d1b58c6e3e5409c767be86f6073de7e2.jpg already downloaded
2026-03-29 12:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252F2a%252Fc32a34b6b27f4bd19cf1729b4d7c693c%252Fpa%252FTT87192_c323c5d6b00477e23ff304cd8d104751.jpg%27 HTTP/1.1" 200 None
2026-03-29 12:00:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/2a/c32a34b6b27f4bd19cf1729b4d7c693c/pa/TT87192_c323c5d6b00477e23ff304cd8d104751.jpg already downloaded
2026-03-29 12:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc3%252F2a%252Fc32a34b6b27f4bd19cf1729b4d7c693c%252Fpa%252FTT87192_39e08fb3e39a03367a87c6b54af6586b.jpg%27 HTTP/1.1" 200 None
2026-03-29 12:00:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc3/2a/c32a34b6b27f4bd19cf1729b4d7c693c/pa/TT87192_39e08fb3e39a03367a87c6b54af6586b.jpg already downloaded
2026-03-29 12:00:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 8adabe83-0ddc-567b-9799-ad5b268c02a3, identifier: TT87192
2026-03-29 12:00:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 8adabe83-0ddc-567b-9799-ad5b268c02a3 with identifier: TT87192
2026-03-29 12:00:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 8adabe83-0ddc-567b-9799-ad5b268c02a3 with identifier: TT87192
2026-03-29 12:00:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 8adabe83-0ddc-567b-9799-ad5b268c02a3 with identifier: TT87192 to the API
2026-03-29 12:00:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 12:00:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 12:00:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/TT87192>
{'auction_title': '',
 'c_o_2_emission_value': 199,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '1.6L',
 'engine_horse_power': 102,
 'expiration_date': '2026-03-30T15:32:54Z',
 'fuel_type': 'petrol',
 'id': '8adabe83-0ddc-567b-9799-ad5b268c02a3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': '44STDD',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TT87192',
 'listing': 'auction',
 'location': 'NL, Oosterhout',
 'make': 'Volkswagen',
 'model': 'Caddy',
 'odometer': 306045,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 5,
 'photo_urls': ['https://img-pa.auto1.com/imgc3/2a/c32a34b6b27f4bd19cf1729b4d7c693c/pa/TT87192_cf7449a457591e8df0d448e2b25e6936.jpg',
                'https://img-pa.auto1.com/imgc3/2a/c32a34b6b27f4bd19cf1729b4d7c693c/pa/TT87192_a0034fee5c2db038ccdebfeb631376a0.jpg',
                'https://img-pa.auto1.com/imgc3/2a/c32a34b6b27f4bd19cf1729b4d7c693c/pa/TT87192_d1b58c6e3e5409c767be86f6073de7e2.jpg',
                'https://img-pa.auto1.com/imgc3/2a/c32a34b6b27f4bd19cf1729b4d7c693c/pa/TT87192_c323c5d6b00477e23ff304cd8d104751.jpg',
                'https://img-pa.auto1.com/imgc3/2a/c32a34b6b27f4bd19cf1729b4d7c693c/pa/TT87192_39e08fb3e39a03367a87c6b54af6586b.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8adabe83-0ddc-567b-9799-ad5b268c02a3/8adabe83-0ddc-567b-9799-ad5b268c02a3_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 115147,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc3/2a/c32a34b6b27f4bd19cf1729b4d7c693c/pa/TT87192_cf7449a457591e8df0d448e2b25e6936.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8adabe83-0ddc-567b-9799-ad5b268c02a3/8adabe83-0ddc-567b-9799-ad5b268c02a3_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 109240,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc3/2a/c32a34b6b27f4bd19cf1729b4d7c693c/pa/TT87192_a0034fee5c2db038ccdebfeb631376a0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8adabe83-0ddc-567b-9799-ad5b268c02a3/8adabe83-0ddc-567b-9799-ad5b268c02a3_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91668,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc3/2a/c32a34b6b27f4bd19cf1729b4d7c693c/pa/TT87192_d1b58c6e3e5409c767be86f6073de7e2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8adabe83-0ddc-567b-9799-ad5b268c02a3/8adabe83-0ddc-567b-9799-ad5b268c02a3_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66540,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc3/2a/c32a34b6b27f4bd19cf1729b4d7c693c/pa/TT87192_c323c5d6b00477e23ff304cd8d104751.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8adabe83-0ddc-567b-9799-ad5b268c02a3/8adabe83-0ddc-567b-9799-ad5b268c02a3_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61784,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc3/2a/c32a34b6b27f4bd19cf1729b4d7c693c/pa/TT87192_39e08fb3e39a03367a87c6b54af6586b.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2006-04-19',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Caddy 1.6 Life',
 'transmission': 'manual',
 'trim': 'Life',
 'year': 2006}
2026-03-29 12:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TT87192%27 HTTP/1.1" 200 None
2026-03-29 12:00:57 [auto1.nl] INFO: Saving data for TT87192: {'created_time': 1774785657.770673, 'last_price_update_time': 1774785657.770684, 'auction_closing_time': 1774884774.0}
2026-03-29 12:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='TT87192') HTTP/1.1" 204 0
2026-03-29 12:01:03 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 12:01:04 [auto1.nl] INFO: Channel: 24h | Page: 7 | totalHits: 759 | hits on page: 40
2026-03-29 12:01:04 [auto1.nl] INFO: Found listing with ID: BZ34461
2026-03-29 12:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BZ34461%27 HTTP/1.1" 200 None
2026-03-29 12:01:04 [auto1.nl] INFO: Scrape type for BZ34461: 0
2026-03-29 12:01:04 [auto1.nl] INFO: Found listing with ID: MY95801
2026-03-29 12:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MY95801%27 HTTP/1.1" 200 None
2026-03-29 12:01:04 [auto1.nl] INFO: Scrape type for MY95801: 0
2026-03-29 12:01:04 [auto1.nl] INFO: Found listing with ID: WP95967
2026-03-29 12:01:04 [auto1.nl] INFO: Found listing with ID: XV01386
2026-03-29 12:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XV01386%27 HTTP/1.1" 200 None
2026-03-29 12:01:04 [auto1.nl] INFO: Scrape type for XV01386: 0
2026-03-29 12:01:04 [auto1.nl] INFO: Found listing with ID: MD48743
2026-03-29 12:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MD48743%27 HTTP/1.1" 200 None
2026-03-29 12:01:04 [auto1.nl] INFO: Scrape type for MD48743: 0
2026-03-29 12:01:04 [auto1.nl] INFO: Found listing with ID: ZL63379
2026-03-29 12:01:04 [auto1.nl] INFO: Found listing with ID: MW60386
2026-03-29 12:01:04 [auto1.nl] INFO: Found listing with ID: DY48945
2026-03-29 12:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DY48945%27 HTTP/1.1" 200 None
2026-03-29 12:01:04 [auto1.nl] INFO: Scrape type for DY48945: 0
2026-03-29 12:01:04 [auto1.nl] INFO: Found listing with ID: CM00428
2026-03-29 12:01:04 [auto1.nl] INFO: Found listing with ID: GW56825
2026-03-29 12:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GW56825%27 HTTP/1.1" 200 None
2026-03-29 12:01:04 [auto1.nl] INFO: Scrape type for GW56825: 0
2026-03-29 12:01:04 [auto1.nl] INFO: Found listing with ID: LD78562
2026-03-29 12:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LD78562%27 HTTP/1.1" 200 None
2026-03-29 12:01:04 [auto1.nl] INFO: Scrape type for LD78562: 0
2026-03-29 12:01:04 [auto1.nl] INFO: Found listing with ID: WD65994
2026-03-29 12:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WD65994%27 HTTP/1.1" 200 None
2026-03-29 12:01:04 [auto1.nl] INFO: Scrape type for WD65994: 0
2026-03-29 12:01:04 [auto1.nl] INFO: Found listing with ID: LK58980
2026-03-29 12:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LK58980%27 HTTP/1.1" 200 None
2026-03-29 12:01:04 [auto1.nl] INFO: Scrape type for LK58980: 0
2026-03-29 12:01:04 [auto1.nl] INFO: Found listing with ID: FJ00169
2026-03-29 12:01:04 [auto1.nl] INFO: Found listing with ID: NL71418
2026-03-29 12:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NL71418%27 HTTP/1.1" 200 None
2026-03-29 12:01:04 [auto1.nl] INFO: Scrape type for NL71418: 0
2026-03-29 12:01:04 [auto1.nl] INFO: Found listing with ID: GP63449
2026-03-29 12:01:04 [auto1.nl] INFO: Found listing with ID: BZ75535
2026-03-29 12:01:04 [auto1.nl] INFO: Found listing with ID: FD60713
2026-03-29 12:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FD60713%27 HTTP/1.1" 200 None
2026-03-29 12:01:04 [auto1.nl] INFO: Scrape type for FD60713: 0
2026-03-29 12:01:04 [auto1.nl] INFO: Found listing with ID: GD83498
2026-03-29 12:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GD83498%27 HTTP/1.1" 200 None
2026-03-29 12:01:04 [auto1.nl] INFO: Scrape type for GD83498: 0
2026-03-29 12:01:04 [auto1.nl] INFO: Found listing with ID: CM82546
2026-03-29 12:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CM82546%27 HTTP/1.1" 200 None
2026-03-29 12:01:04 [auto1.nl] INFO: Scrape type for CM82546: 0
2026-03-29 12:01:04 [auto1.nl] INFO: Found listing with ID: DH15529
2026-03-29 12:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DH15529%27 HTTP/1.1" 200 None
2026-03-29 12:01:04 [auto1.nl] INFO: Scrape type for DH15529: 0
2026-03-29 12:01:04 [auto1.nl] INFO: Found listing with ID: YW81523
2026-03-29 12:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YW81523%27 HTTP/1.1" 200 None
2026-03-29 12:01:04 [auto1.nl] INFO: Scrape type for YW81523: 0
2026-03-29 12:01:04 [auto1.nl] INFO: Found listing with ID: KK56723
2026-03-29 12:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KK56723%27 HTTP/1.1" 200 None
2026-03-29 12:01:04 [auto1.nl] INFO: Scrape type for KK56723: 0
2026-03-29 12:01:04 [auto1.nl] INFO: Found listing with ID: PE89486
2026-03-29 12:01:04 [auto1.nl] INFO: Found listing with ID: CR31925
2026-03-29 12:01:04 [auto1.nl] INFO: Found listing with ID: UR99157
2026-03-29 12:01:04 [auto1.nl] INFO: Found listing with ID: UJ24113
2026-03-29 12:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UJ24113%27 HTTP/1.1" 200 None
2026-03-29 12:01:04 [auto1.nl] INFO: Scrape type for UJ24113: 0
2026-03-29 12:01:04 [auto1.nl] INFO: Found listing with ID: ZX00670
2026-03-29 12:01:04 [auto1.nl] INFO: Found listing with ID: ZC66376
2026-03-29 12:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZC66376%27 HTTP/1.1" 200 None
2026-03-29 12:01:04 [auto1.nl] INFO: Scrape type for ZC66376: 0
2026-03-29 12:01:04 [auto1.nl] INFO: Found listing with ID: CW75343
2026-03-29 12:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CW75343%27 HTTP/1.1" 200 None
2026-03-29 12:01:04 [auto1.nl] INFO: Scrape type for CW75343: 0
2026-03-29 12:01:04 [auto1.nl] INFO: Found listing with ID: DF87411
2026-03-29 12:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DF87411%27 HTTP/1.1" 200 None
2026-03-29 12:01:04 [auto1.nl] INFO: Scrape type for DF87411: 0
2026-03-29 12:01:04 [auto1.nl] INFO: Found listing with ID: NP69601
2026-03-29 12:01:04 [auto1.nl] INFO: Found listing with ID: SR40415
2026-03-29 12:01:04 [auto1.nl] INFO: Found listing with ID: HX69861
2026-03-29 12:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HX69861%27 HTTP/1.1" 200 None
2026-03-29 12:01:04 [auto1.nl] INFO: Scrape type for HX69861: 0
2026-03-29 12:01:04 [auto1.nl] INFO: Found listing with ID: SD33545
2026-03-29 12:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SD33545%27 HTTP/1.1" 200 None
2026-03-29 12:01:04 [auto1.nl] INFO: Scrape type for SD33545: 0
2026-03-29 12:01:04 [auto1.nl] INFO: Found listing with ID: NR15886
2026-03-29 12:01:04 [auto1.nl] INFO: Found listing with ID: JZ14599
2026-03-29 12:01:04 [auto1.nl] INFO: Found listing with ID: VA79192
2026-03-29 12:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VA79192%27 HTTP/1.1" 200 None
2026-03-29 12:01:04 [auto1.nl] INFO: Scrape type for VA79192: 0
2026-03-29 12:01:04 [auto1.nl] INFO: Found listing with ID: FL22944
2026-03-29 12:01:04 [auto1.nl] INFO: Found listing with ID: ME98271
2026-03-29 12:01:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 12:01:05 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 12:01:05 [auto1.nl] INFO: Channel: 24h | Page: 8 | totalHits: 759 | hits on page: 40
2026-03-29 12:01:05 [auto1.nl] INFO: Found listing with ID: DK58919
2026-03-29 12:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DK58919%27 HTTP/1.1" 200 None
2026-03-29 12:01:05 [auto1.nl] INFO: Scrape type for DK58919: 0
2026-03-29 12:01:05 [auto1.nl] INFO: Found listing with ID: CK43593
2026-03-29 12:01:05 [auto1.nl] INFO: Found listing with ID: JC35078
2026-03-29 12:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JC35078%27 HTTP/1.1" 200 None
2026-03-29 12:01:05 [auto1.nl] INFO: Scrape type for JC35078: 0
2026-03-29 12:01:05 [auto1.nl] INFO: Found listing with ID: CL96583
2026-03-29 12:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CL96583%27 HTTP/1.1" 200 None
2026-03-29 12:01:05 [auto1.nl] INFO: Scrape type for CL96583: 0
2026-03-29 12:01:05 [auto1.nl] INFO: Found listing with ID: WH69219
2026-03-29 12:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WH69219%27 HTTP/1.1" 200 None
2026-03-29 12:01:05 [auto1.nl] INFO: Scrape type for WH69219: 0
2026-03-29 12:01:05 [auto1.nl] INFO: Found listing with ID: JS19868
2026-03-29 12:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JS19868%27 HTTP/1.1" 200 None
2026-03-29 12:01:05 [auto1.nl] INFO: Scrape type for JS19868: 0
2026-03-29 12:01:05 [auto1.nl] INFO: Found listing with ID: SV78620
2026-03-29 12:01:05 [auto1.nl] INFO: Found listing with ID: FU31497
2026-03-29 12:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FU31497%27 HTTP/1.1" 200 None
2026-03-29 12:01:05 [auto1.nl] INFO: Scrape type for FU31497: 0
2026-03-29 12:01:05 [auto1.nl] INFO: Found listing with ID: NV42843
2026-03-29 12:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NV42843%27 HTTP/1.1" 200 None
2026-03-29 12:01:05 [auto1.nl] INFO: Scrape type for NV42843: 0
2026-03-29 12:01:05 [auto1.nl] INFO: Found listing with ID: MF68511
2026-03-29 12:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MF68511%27 HTTP/1.1" 200 None
2026-03-29 12:01:06 [auto1.nl] INFO: Scrape type for MF68511: 0
2026-03-29 12:01:06 [auto1.nl] INFO: Found listing with ID: VA70092
2026-03-29 12:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VA70092%27 HTTP/1.1" 200 None
2026-03-29 12:01:06 [auto1.nl] INFO: Scrape type for VA70092: 0
2026-03-29 12:01:06 [auto1.nl] INFO: Found listing with ID: HZ82321
2026-03-29 12:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HZ82321%27 HTTP/1.1" 200 None
2026-03-29 12:01:06 [auto1.nl] INFO: Scrape type for HZ82321: 0
2026-03-29 12:01:06 [auto1.nl] INFO: Found listing with ID: YZ85937
2026-03-29 12:01:06 [auto1.nl] INFO: Found listing with ID: ZX63291
2026-03-29 12:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZX63291%27 HTTP/1.1" 200 None
2026-03-29 12:01:06 [auto1.nl] INFO: Scrape type for ZX63291: 0
2026-03-29 12:01:06 [auto1.nl] INFO: Found listing with ID: MZ50492
2026-03-29 12:01:06 [auto1.nl] INFO: Found listing with ID: UY18740
2026-03-29 12:01:06 [auto1.nl] INFO: Found listing with ID: UJ05110
2026-03-29 12:01:06 [auto1.nl] INFO: Found listing with ID: FB74313
2026-03-29 12:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FB74313%27 HTTP/1.1" 200 None
2026-03-29 12:01:06 [auto1.nl] INFO: Scrape type for FB74313: 0
2026-03-29 12:01:06 [auto1.nl] INFO: Found listing with ID: MJ47722
2026-03-29 12:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MJ47722%27 HTTP/1.1" 200 None
2026-03-29 12:01:06 [auto1.nl] INFO: Scrape type for MJ47722: 0
2026-03-29 12:01:06 [auto1.nl] INFO: Found listing with ID: XG57923
2026-03-29 12:01:06 [auto1.nl] INFO: Found listing with ID: RP15329
2026-03-29 12:01:06 [auto1.nl] INFO: Found listing with ID: VM41876
2026-03-29 12:01:06 [auto1.nl] INFO: Found listing with ID: FH34143
2026-03-29 12:01:06 [auto1.nl] INFO: Found listing with ID: FW39949
2026-03-29 12:01:06 [auto1.nl] INFO: Found listing with ID: ZP69271
2026-03-29 12:01:06 [auto1.nl] INFO: Found listing with ID: LL90951
2026-03-29 12:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LL90951%27 HTTP/1.1" 200 None
2026-03-29 12:01:06 [auto1.nl] INFO: Scrape type for LL90951: 0
2026-03-29 12:01:06 [auto1.nl] INFO: Found listing with ID: VD56637
2026-03-29 12:01:06 [auto1.nl] INFO: Found listing with ID: BY94157
2026-03-29 12:01:06 [auto1.nl] INFO: Found listing with ID: JK88621
2026-03-29 12:01:06 [auto1.nl] INFO: Found listing with ID: WX34396
2026-03-29 12:01:06 [auto1.nl] INFO: Found listing with ID: XD61678
2026-03-29 12:01:06 [auto1.nl] INFO: Found listing with ID: JT64166
2026-03-29 12:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JT64166%27 HTTP/1.1" 200 None
2026-03-29 12:01:06 [auto1.nl] INFO: Scrape type for JT64166: 0
2026-03-29 12:01:06 [auto1.nl] INFO: Found listing with ID: YK98733
2026-03-29 12:01:06 [auto1.nl] INFO: Found listing with ID: YP25238
2026-03-29 12:01:06 [auto1.nl] INFO: Found listing with ID: XA85497
2026-03-29 12:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XA85497%27 HTTP/1.1" 200 None
2026-03-29 12:01:06 [auto1.nl] INFO: Scrape type for XA85497: 0
2026-03-29 12:01:06 [auto1.nl] INFO: Found listing with ID: WC04014
2026-03-29 12:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WC04014%27 HTTP/1.1" 200 None
2026-03-29 12:01:06 [auto1.nl] INFO: Scrape type for WC04014: 0
2026-03-29 12:01:06 [auto1.nl] INFO: Found listing with ID: HD17412
2026-03-29 12:01:06 [auto1.nl] INFO: Found listing with ID: MX82019
2026-03-29 12:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MX82019%27 HTTP/1.1" 200 None
2026-03-29 12:01:06 [auto1.nl] INFO: Scrape type for MX82019: 0
2026-03-29 12:01:06 [auto1.nl] INFO: Found listing with ID: ES69537
2026-03-29 12:01:06 [auto1.nl] INFO: Found listing with ID: WS29354
2026-03-29 12:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WS29354%27 HTTP/1.1" 200 None
2026-03-29 12:01:06 [auto1.nl] INFO: Scrape type for WS29354: 0
2026-03-29 12:01:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 12:01:06 [scrapy.extensions.logstats] INFO: Crawled 34 pages (at 34 pages/min), scraped 66 items (at 66 items/min)
2026-03-29 12:01:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 160MiB
2026-03-29 12:01:07 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 12:01:07 [auto1.nl] INFO: Channel: 24h | Page: 9 | totalHits: 759 | hits on page: 40
2026-03-29 12:01:07 [auto1.nl] INFO: Found listing with ID: ZD81791
2026-03-29 12:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZD81791%27 HTTP/1.1" 200 None
2026-03-29 12:01:07 [auto1.nl] INFO: Scrape type for ZD81791: 0
2026-03-29 12:01:07 [auto1.nl] INFO: Found listing with ID: CR08212
2026-03-29 12:01:07 [auto1.nl] INFO: Found listing with ID: GN05115
2026-03-29 12:01:07 [auto1.nl] INFO: Found listing with ID: NK23750
2026-03-29 12:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NK23750%27 HTTP/1.1" 200 None
2026-03-29 12:01:07 [auto1.nl] INFO: Scrape type for NK23750: 0
2026-03-29 12:01:07 [auto1.nl] INFO: Found listing with ID: LT61011
2026-03-29 12:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LT61011%27 HTTP/1.1" 200 None
2026-03-29 12:01:07 [auto1.nl] INFO: Scrape type for LT61011: 0
2026-03-29 12:01:07 [auto1.nl] INFO: Found listing with ID: CT54062
2026-03-29 12:01:07 [auto1.nl] INFO: Found listing with ID: PZ45874
2026-03-29 12:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PZ45874%27 HTTP/1.1" 200 None
2026-03-29 12:01:07 [auto1.nl] INFO: Scrape type for PZ45874: 0
2026-03-29 12:01:07 [auto1.nl] INFO: Found listing with ID: RY75066
2026-03-29 12:01:07 [auto1.nl] INFO: Found listing with ID: VJ86590
2026-03-29 12:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VJ86590%27 HTTP/1.1" 200 None
2026-03-29 12:01:07 [auto1.nl] INFO: Scrape type for VJ86590: 0
2026-03-29 12:01:07 [auto1.nl] INFO: Found listing with ID: EK38089
2026-03-29 12:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EK38089%27 HTTP/1.1" 200 None
2026-03-29 12:01:07 [auto1.nl] INFO: Scrape type for EK38089: 0
2026-03-29 12:01:07 [auto1.nl] INFO: Found listing with ID: CJ41969
2026-03-29 12:01:07 [auto1.nl] INFO: Found listing with ID: BD37870
2026-03-29 12:01:07 [auto1.nl] INFO: Found listing with ID: FR87941
2026-03-29 12:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FR87941%27 HTTP/1.1" 200 None
2026-03-29 12:01:07 [auto1.nl] INFO: Scrape type for FR87941: 0
2026-03-29 12:01:07 [auto1.nl] INFO: Found listing with ID: WK29789
2026-03-29 12:01:07 [auto1.nl] INFO: Found listing with ID: EL29526
2026-03-29 12:01:07 [auto1.nl] INFO: Found listing with ID: KV87922
2026-03-29 12:01:07 [auto1.nl] INFO: Found listing with ID: CP17463
2026-03-29 12:01:07 [auto1.nl] INFO: Found listing with ID: SX81397
2026-03-29 12:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SX81397%27 HTTP/1.1" 200 None
2026-03-29 12:01:07 [auto1.nl] INFO: Scrape type for SX81397: 0
2026-03-29 12:01:07 [auto1.nl] INFO: Found listing with ID: UV82075
2026-03-29 12:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UV82075%27 HTTP/1.1" 200 None
2026-03-29 12:01:07 [auto1.nl] INFO: Scrape type for UV82075: 0
2026-03-29 12:01:07 [auto1.nl] INFO: Found listing with ID: WW80908
2026-03-29 12:01:07 [auto1.nl] INFO: Found listing with ID: SM80467
2026-03-29 12:01:07 [auto1.nl] INFO: Found listing with ID: EH64896
2026-03-29 12:01:07 [auto1.nl] INFO: Found listing with ID: DB11708
2026-03-29 12:01:07 [auto1.nl] INFO: Found listing with ID: TU10821
2026-03-29 12:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TU10821%27 HTTP/1.1" 200 None
2026-03-29 12:01:07 [auto1.nl] INFO: Scrape type for TU10821: 0
2026-03-29 12:01:07 [auto1.nl] INFO: Found listing with ID: ZD26534
2026-03-29 12:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZD26534%27 HTTP/1.1" 200 None
2026-03-29 12:01:07 [auto1.nl] INFO: Scrape type for ZD26534: 0
2026-03-29 12:01:07 [auto1.nl] INFO: Found listing with ID: PX51139
2026-03-29 12:01:07 [auto1.nl] INFO: Found listing with ID: TY61758
2026-03-29 12:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TY61758%27 HTTP/1.1" 200 None
2026-03-29 12:01:07 [auto1.nl] INFO: Scrape type for TY61758: 0
2026-03-29 12:01:07 [auto1.nl] INFO: Found listing with ID: AZ42388
2026-03-29 12:01:07 [auto1.nl] INFO: Found listing with ID: DU88284
2026-03-29 12:01:07 [auto1.nl] INFO: Found listing with ID: PG46787
2026-03-29 12:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PG46787%27 HTTP/1.1" 200 None
2026-03-29 12:01:07 [auto1.nl] INFO: Scrape type for PG46787: 0
2026-03-29 12:01:07 [auto1.nl] INFO: Found listing with ID: TW55830
2026-03-29 12:01:07 [auto1.nl] INFO: Found listing with ID: HB03885
2026-03-29 12:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HB03885%27 HTTP/1.1" 200 None
2026-03-29 12:01:07 [auto1.nl] INFO: Scrape type for HB03885: 0
2026-03-29 12:01:07 [auto1.nl] INFO: Found listing with ID: CG77801
2026-03-29 12:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CG77801%27 HTTP/1.1" 200 None
2026-03-29 12:01:07 [auto1.nl] INFO: Scrape type for CG77801: 0
2026-03-29 12:01:07 [auto1.nl] INFO: Found listing with ID: BU16200
2026-03-29 12:01:07 [auto1.nl] INFO: Found listing with ID: PA43644
2026-03-29 12:01:07 [auto1.nl] INFO: Found listing with ID: HC58225
2026-03-29 12:01:07 [auto1.nl] INFO: Found listing with ID: JX76832
2026-03-29 12:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JX76832%27 HTTP/1.1" 200 None
2026-03-29 12:01:07 [auto1.nl] INFO: Scrape type for JX76832: 0
2026-03-29 12:01:07 [auto1.nl] INFO: Found listing with ID: KB67971
2026-03-29 12:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KB67971%27 HTTP/1.1" 200 None
2026-03-29 12:01:07 [auto1.nl] INFO: Scrape type for KB67971: 0
2026-03-29 12:01:07 [auto1.nl] INFO: Found listing with ID: CU35423
2026-03-29 12:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CU35423%27 HTTP/1.1" 200 None
2026-03-29 12:01:07 [auto1.nl] INFO: Scrape type for CU35423: 0
2026-03-29 12:01:07 [auto1.nl] INFO: Found listing with ID: XW28642
2026-03-29 12:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XW28642%27 HTTP/1.1" 200 None
2026-03-29 12:01:07 [auto1.nl] INFO: Scrape type for XW28642: 0
2026-03-29 12:01:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 12:01:08 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 12:01:08 [auto1.nl] INFO: Channel: 24h | Page: 10 | totalHits: 759 | hits on page: 40
2026-03-29 12:01:08 [auto1.nl] INFO: Found listing with ID: SY53039
2026-03-29 12:01:08 [auto1.nl] INFO: Found listing with ID: DN96174
2026-03-29 12:01:08 [auto1.nl] INFO: Found listing with ID: BD28084
2026-03-29 12:01:08 [auto1.nl] INFO: Found listing with ID: SE84312
2026-03-29 12:01:08 [auto1.nl] INFO: Found listing with ID: RF39867
2026-03-29 12:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RF39867%27 HTTP/1.1" 200 None
2026-03-29 12:01:08 [auto1.nl] INFO: Scrape type for RF39867: 0
2026-03-29 12:01:08 [auto1.nl] INFO: Found listing with ID: DZ87358
2026-03-29 12:01:08 [auto1.nl] INFO: Found listing with ID: LE78061
2026-03-29 12:01:08 [auto1.nl] INFO: Found listing with ID: RC74228
2026-03-29 12:01:08 [auto1.nl] INFO: Found listing with ID: MD57319
2026-03-29 12:01:08 [auto1.nl] INFO: Found listing with ID: JG11787
2026-03-29 12:01:08 [auto1.nl] INFO: Found listing with ID: NT33284
2026-03-29 12:01:08 [auto1.nl] INFO: Found listing with ID: MU53685
2026-03-29 12:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MU53685%27 HTTP/1.1" 200 None
2026-03-29 12:01:08 [auto1.nl] INFO: Scrape type for MU53685: 0
2026-03-29 12:01:08 [auto1.nl] INFO: Found listing with ID: EE94160
2026-03-29 12:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EE94160%27 HTTP/1.1" 200 None
2026-03-29 12:01:08 [auto1.nl] INFO: Scrape type for EE94160: 0
2026-03-29 12:01:08 [auto1.nl] INFO: Found listing with ID: FR68688
2026-03-29 12:01:08 [auto1.nl] INFO: Found listing with ID: AE06801
2026-03-29 12:01:08 [auto1.nl] INFO: Found listing with ID: WF02577
2026-03-29 12:01:08 [auto1.nl] INFO: Found listing with ID: CH10226
2026-03-29 12:01:08 [auto1.nl] INFO: Found listing with ID: WZ36257
2026-03-29 12:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WZ36257%27 HTTP/1.1" 200 None
2026-03-29 12:01:08 [auto1.nl] INFO: Scrape type for WZ36257: 0
2026-03-29 12:01:08 [auto1.nl] INFO: Found listing with ID: BM26306
2026-03-29 12:01:08 [auto1.nl] INFO: Found listing with ID: MT73533
2026-03-29 12:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MT73533%27 HTTP/1.1" 200 None
2026-03-29 12:01:08 [auto1.nl] INFO: Scrape type for MT73533: 0
2026-03-29 12:01:08 [auto1.nl] INFO: Found listing with ID: KD04773
2026-03-29 12:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KD04773%27 HTTP/1.1" 200 None
2026-03-29 12:01:08 [auto1.nl] INFO: Scrape type for KD04773: 0
2026-03-29 12:01:08 [auto1.nl] INFO: Found listing with ID: NE94931
2026-03-29 12:01:08 [auto1.nl] INFO: Found listing with ID: UF74705
2026-03-29 12:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UF74705%27 HTTP/1.1" 200 None
2026-03-29 12:01:08 [auto1.nl] INFO: Scrape type for UF74705: 0
2026-03-29 12:01:08 [auto1.nl] INFO: Found listing with ID: JS13271
2026-03-29 12:01:08 [auto1.nl] INFO: Found listing with ID: WG27101
2026-03-29 12:01:08 [auto1.nl] INFO: Found listing with ID: SA72680
2026-03-29 12:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SA72680%27 HTTP/1.1" 200 None
2026-03-29 12:01:08 [auto1.nl] INFO: Scrape type for SA72680: 0
2026-03-29 12:01:08 [auto1.nl] INFO: Found listing with ID: MY24327
2026-03-29 12:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MY24327%27 HTTP/1.1" 200 None
2026-03-29 12:01:08 [auto1.nl] INFO: Scrape type for MY24327: 0
2026-03-29 12:01:08 [auto1.nl] INFO: Found listing with ID: UB80121
2026-03-29 12:01:08 [auto1.nl] INFO: Found listing with ID: WC55998
2026-03-29 12:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WC55998%27 HTTP/1.1" 200 None
2026-03-29 12:01:08 [auto1.nl] INFO: Scrape type for WC55998: 0
2026-03-29 12:01:08 [auto1.nl] INFO: Found listing with ID: EN44222
2026-03-29 12:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EN44222%27 HTTP/1.1" 200 None
2026-03-29 12:01:08 [auto1.nl] INFO: Scrape type for EN44222: 0
2026-03-29 12:01:08 [auto1.nl] INFO: Found listing with ID: YE50957
2026-03-29 12:01:08 [auto1.nl] INFO: Found listing with ID: BC03068
2026-03-29 12:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BC03068%27 HTTP/1.1" 200 None
2026-03-29 12:01:09 [auto1.nl] INFO: Scrape type for BC03068: 0
2026-03-29 12:01:09 [auto1.nl] INFO: Found listing with ID: VT73125
2026-03-29 12:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VT73125%27 HTTP/1.1" 200 None
2026-03-29 12:01:09 [auto1.nl] INFO: Scrape type for VT73125: 0
2026-03-29 12:01:09 [auto1.nl] INFO: Found listing with ID: LF56220
2026-03-29 12:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LF56220%27 HTTP/1.1" 200 None
2026-03-29 12:01:09 [auto1.nl] INFO: Scrape type for LF56220: 0
2026-03-29 12:01:09 [auto1.nl] INFO: Found listing with ID: VU71978
2026-03-29 12:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VU71978%27 HTTP/1.1" 200 None
2026-03-29 12:01:09 [auto1.nl] INFO: Scrape type for VU71978: 0
2026-03-29 12:01:09 [auto1.nl] INFO: Found listing with ID: VH08569
2026-03-29 12:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VH08569%27 HTTP/1.1" 200 None
2026-03-29 12:01:09 [auto1.nl] INFO: Scrape type for VH08569: 0
2026-03-29 12:01:09 [auto1.nl] INFO: Found listing with ID: AY58936
2026-03-29 12:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AY58936%27 HTTP/1.1" 200 None
2026-03-29 12:01:09 [auto1.nl] INFO: Scrape type for AY58936: 0
2026-03-29 12:01:09 [auto1.nl] INFO: Found listing with ID: YH72796
2026-03-29 12:01:09 [auto1.nl] INFO: Found listing with ID: AE74076
2026-03-29 12:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AE74076%27 HTTP/1.1" 200 None
2026-03-29 12:01:09 [auto1.nl] INFO: Scrape type for AE74076: 0
2026-03-29 12:01:09 [auto1.nl] INFO: Found listing with ID: GG02103
2026-03-29 12:01:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 12:01:10 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 12:01:10 [auto1.nl] INFO: Channel: 24h | Page: 11 | totalHits: 759 | hits on page: 40
2026-03-29 12:01:10 [auto1.nl] INFO: Found listing with ID: NB25760
2026-03-29 12:01:10 [auto1.nl] INFO: Found listing with ID: XJ71773
2026-03-29 12:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XJ71773%27 HTTP/1.1" 200 None
2026-03-29 12:01:10 [auto1.nl] INFO: Scrape type for XJ71773: 0
2026-03-29 12:01:10 [auto1.nl] INFO: Found listing with ID: GY41852
2026-03-29 12:01:10 [auto1.nl] INFO: Found listing with ID: LF75031
2026-03-29 12:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LF75031%27 HTTP/1.1" 200 None
2026-03-29 12:01:10 [auto1.nl] INFO: Scrape type for LF75031: 0
2026-03-29 12:01:10 [auto1.nl] INFO: Found listing with ID: PP29341
2026-03-29 12:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PP29341%27 HTTP/1.1" 200 None
2026-03-29 12:01:10 [auto1.nl] INFO: Scrape type for PP29341: 0
2026-03-29 12:01:10 [auto1.nl] INFO: Found listing with ID: ZY76952
2026-03-29 12:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZY76952%27 HTTP/1.1" 200 None
2026-03-29 12:01:10 [auto1.nl] INFO: Scrape type for ZY76952: 0
2026-03-29 12:01:10 [auto1.nl] INFO: Found listing with ID: FC33520
2026-03-29 12:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FC33520%27 HTTP/1.1" 200 None
2026-03-29 12:01:10 [auto1.nl] INFO: Scrape type for FC33520: 0
2026-03-29 12:01:10 [auto1.nl] INFO: Found listing with ID: NF23683
2026-03-29 12:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NF23683%27 HTTP/1.1" 200 None
2026-03-29 12:01:10 [auto1.nl] INFO: Scrape type for NF23683: 0
2026-03-29 12:01:10 [auto1.nl] INFO: Found listing with ID: EG83115
2026-03-29 12:01:10 [auto1.nl] INFO: Found listing with ID: CR43638
2026-03-29 12:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CR43638%27 HTTP/1.1" 200 None
2026-03-29 12:01:10 [auto1.nl] INFO: Scrape type for CR43638: 0
2026-03-29 12:01:10 [auto1.nl] INFO: Found listing with ID: LH66044
2026-03-29 12:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LH66044%27 HTTP/1.1" 200 None
2026-03-29 12:01:10 [auto1.nl] INFO: Scrape type for LH66044: 0
2026-03-29 12:01:10 [auto1.nl] INFO: Found listing with ID: UC91516
2026-03-29 12:01:10 [auto1.nl] INFO: Found listing with ID: DA29812
2026-03-29 12:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DA29812%27 HTTP/1.1" 200 None
2026-03-29 12:01:10 [auto1.nl] INFO: Scrape type for DA29812: 0
2026-03-29 12:01:10 [auto1.nl] INFO: Found listing with ID: XJ87481
2026-03-29 12:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XJ87481%27 HTTP/1.1" 200 None
2026-03-29 12:01:10 [auto1.nl] INFO: Scrape type for XJ87481: 0
2026-03-29 12:01:10 [auto1.nl] INFO: Found listing with ID: EM54492
2026-03-29 12:01:10 [auto1.nl] INFO: Found listing with ID: NH69771
2026-03-29 12:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NH69771%27 HTTP/1.1" 200 None
2026-03-29 12:01:10 [auto1.nl] INFO: Scrape type for NH69771: 0
2026-03-29 12:01:10 [auto1.nl] INFO: Found listing with ID: YZ09106
2026-03-29 12:01:10 [auto1.nl] INFO: Found listing with ID: AM42063
2026-03-29 12:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AM42063%27 HTTP/1.1" 200 None
2026-03-29 12:01:10 [auto1.nl] INFO: Scrape type for AM42063: 0
2026-03-29 12:01:10 [auto1.nl] INFO: Found listing with ID: SB99593
2026-03-29 12:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SB99593%27 HTTP/1.1" 200 None
2026-03-29 12:01:10 [auto1.nl] INFO: Scrape type for SB99593: 0
2026-03-29 12:01:10 [auto1.nl] INFO: Found listing with ID: VV88142
2026-03-29 12:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VV88142%27 HTTP/1.1" 200 None
2026-03-29 12:01:10 [auto1.nl] INFO: Scrape type for VV88142: 0
2026-03-29 12:01:10 [auto1.nl] INFO: Found listing with ID: GN89359
2026-03-29 12:01:10 [auto1.nl] INFO: Found listing with ID: TC30391
2026-03-29 12:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TC30391%27 HTTP/1.1" 200 None
2026-03-29 12:01:10 [auto1.nl] INFO: Scrape type for TC30391: 0
2026-03-29 12:01:10 [auto1.nl] INFO: Found listing with ID: NS14796
2026-03-29 12:01:10 [auto1.nl] INFO: Found listing with ID: KV69786
2026-03-29 12:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KV69786%27 HTTP/1.1" 200 None
2026-03-29 12:01:10 [auto1.nl] INFO: Scrape type for KV69786: 0
2026-03-29 12:01:10 [auto1.nl] INFO: Found listing with ID: AZ90827
2026-03-29 12:01:10 [auto1.nl] INFO: Found listing with ID: JX11008
2026-03-29 12:01:10 [auto1.nl] INFO: Found listing with ID: VH01672
2026-03-29 12:01:10 [auto1.nl] INFO: Found listing with ID: EM66057
2026-03-29 12:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EM66057%27 HTTP/1.1" 200 None
2026-03-29 12:01:10 [auto1.nl] INFO: Scrape type for EM66057: 0
2026-03-29 12:01:10 [auto1.nl] INFO: Found listing with ID: AL57491
2026-03-29 12:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AL57491%27 HTTP/1.1" 200 None
2026-03-29 12:01:10 [auto1.nl] INFO: Scrape type for AL57491: 0
2026-03-29 12:01:10 [auto1.nl] INFO: Found listing with ID: MW03156
2026-03-29 12:01:10 [auto1.nl] INFO: Found listing with ID: HJ58386
2026-03-29 12:01:10 [auto1.nl] INFO: Found listing with ID: VR09113
2026-03-29 12:01:10 [auto1.nl] INFO: Found listing with ID: ML76723
2026-03-29 12:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ML76723%27 HTTP/1.1" 200 None
2026-03-29 12:01:10 [auto1.nl] INFO: Scrape type for ML76723: 0
2026-03-29 12:01:10 [auto1.nl] INFO: Found listing with ID: GK86118
2026-03-29 12:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GK86118%27 HTTP/1.1" 200 None
2026-03-29 12:01:10 [auto1.nl] INFO: Scrape type for GK86118: 0
2026-03-29 12:01:10 [auto1.nl] INFO: Found listing with ID: PD24155
2026-03-29 12:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PD24155%27 HTTP/1.1" 200 None
2026-03-29 12:01:10 [auto1.nl] INFO: Scrape type for PD24155: 0
2026-03-29 12:01:10 [auto1.nl] INFO: Found listing with ID: FH88416
2026-03-29 12:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FH88416%27 HTTP/1.1" 200 None
2026-03-29 12:01:10 [auto1.nl] INFO: Scrape type for FH88416: 0
2026-03-29 12:01:10 [auto1.nl] INFO: Found listing with ID: KD36085
2026-03-29 12:01:10 [auto1.nl] INFO: Found listing with ID: JN86544
2026-03-29 12:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JN86544%27 HTTP/1.1" 200 None
2026-03-29 12:01:10 [auto1.nl] INFO: Scrape type for JN86544: 0
2026-03-29 12:01:10 [auto1.nl] INFO: Found listing with ID: GY00070
2026-03-29 12:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GY00070%27 HTTP/1.1" 200 None
2026-03-29 12:01:10 [auto1.nl] INFO: Scrape type for GY00070: 0
2026-03-29 12:01:10 [auto1.nl] INFO: Found listing with ID: GB93242
2026-03-29 12:01:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 12:01:11 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 12:01:11 [auto1.nl] INFO: Channel: 24h | Page: 12 | totalHits: 759 | hits on page: 40
2026-03-29 12:01:11 [auto1.nl] INFO: Found listing with ID: YN37403
2026-03-29 12:01:11 [auto1.nl] INFO: Found listing with ID: FE21861
2026-03-29 12:01:11 [auto1.nl] INFO: Found listing with ID: HZ03058
2026-03-29 12:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HZ03058%27 HTTP/1.1" 200 None
2026-03-29 12:01:11 [auto1.nl] INFO: Scrape type for HZ03058: 0
2026-03-29 12:01:11 [auto1.nl] INFO: Found listing with ID: FA84913
2026-03-29 12:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FA84913%27 HTTP/1.1" 200 None
2026-03-29 12:01:11 [auto1.nl] INFO: Scrape type for FA84913: 0
2026-03-29 12:01:11 [auto1.nl] INFO: Found listing with ID: FK39304
2026-03-29 12:01:11 [auto1.nl] INFO: Found listing with ID: LU83430
2026-03-29 12:01:11 [auto1.nl] INFO: Found listing with ID: PY93062
2026-03-29 12:01:11 [auto1.nl] INFO: Found listing with ID: DD65196
2026-03-29 12:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DD65196%27 HTTP/1.1" 200 None
2026-03-29 12:01:11 [auto1.nl] INFO: Scrape type for DD65196: 0
2026-03-29 12:01:11 [auto1.nl] INFO: Found listing with ID: CC90793
2026-03-29 12:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CC90793%27 HTTP/1.1" 200 None
2026-03-29 12:01:11 [auto1.nl] INFO: Scrape type for CC90793: 0
2026-03-29 12:01:11 [auto1.nl] INFO: Found listing with ID: LG18300
2026-03-29 12:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LG18300%27 HTTP/1.1" 200 None
2026-03-29 12:01:11 [auto1.nl] INFO: Scrape type for LG18300: 0
2026-03-29 12:01:11 [auto1.nl] INFO: Found listing with ID: RF14080
2026-03-29 12:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RF14080%27 HTTP/1.1" 200 None
2026-03-29 12:01:11 [auto1.nl] INFO: Scrape type for RF14080: 0
2026-03-29 12:01:11 [auto1.nl] INFO: Found listing with ID: PY55457
2026-03-29 12:01:11 [auto1.nl] INFO: Found listing with ID: AG89497
2026-03-29 12:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AG89497%27 HTTP/1.1" 200 None
2026-03-29 12:01:11 [auto1.nl] INFO: Scrape type for AG89497: 0
2026-03-29 12:01:11 [auto1.nl] INFO: Found listing with ID: CL54405
2026-03-29 12:01:11 [auto1.nl] INFO: Found listing with ID: AJ38016
2026-03-29 12:01:11 [auto1.nl] INFO: Found listing with ID: HW48392
2026-03-29 12:01:11 [auto1.nl] INFO: Found listing with ID: KP98004
2026-03-29 12:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KP98004%27 HTTP/1.1" 200 None
2026-03-29 12:01:11 [auto1.nl] INFO: Scrape type for KP98004: 0
2026-03-29 12:01:11 [auto1.nl] INFO: Found listing with ID: RJ32742
2026-03-29 12:01:11 [auto1.nl] INFO: Found listing with ID: PP40573
2026-03-29 12:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PP40573%27 HTTP/1.1" 200 None
2026-03-29 12:01:11 [auto1.nl] INFO: Scrape type for PP40573: 0
2026-03-29 12:01:11 [auto1.nl] INFO: Found listing with ID: MD45251
2026-03-29 12:01:11 [auto1.nl] INFO: Found listing with ID: ME73088
2026-03-29 12:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ME73088%27 HTTP/1.1" 200 None
2026-03-29 12:01:11 [auto1.nl] INFO: Scrape type for ME73088: 0
2026-03-29 12:01:11 [auto1.nl] INFO: Found listing with ID: BD38212
2026-03-29 12:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BD38212%27 HTTP/1.1" 200 None
2026-03-29 12:01:11 [auto1.nl] INFO: Scrape type for BD38212: 0
2026-03-29 12:01:11 [auto1.nl] INFO: Found listing with ID: EJ39658
2026-03-29 12:01:11 [auto1.nl] INFO: Found listing with ID: JA96094
2026-03-29 12:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JA96094%27 HTTP/1.1" 200 None
2026-03-29 12:01:11 [auto1.nl] INFO: Scrape type for JA96094: 0
2026-03-29 12:01:11 [auto1.nl] INFO: Found listing with ID: ME20407
2026-03-29 12:01:11 [auto1.nl] INFO: Found listing with ID: ZR26013
2026-03-29 12:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZR26013%27 HTTP/1.1" 200 None
2026-03-29 12:01:11 [auto1.nl] INFO: Scrape type for ZR26013: 0
2026-03-29 12:01:11 [auto1.nl] INFO: Found listing with ID: LG71332
2026-03-29 12:01:11 [auto1.nl] INFO: Found listing with ID: RM92541
2026-03-29 12:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RM92541%27 HTTP/1.1" 200 None
2026-03-29 12:01:11 [auto1.nl] INFO: Scrape type for RM92541: 0
2026-03-29 12:01:11 [auto1.nl] INFO: Found listing with ID: KF49809
2026-03-29 12:01:11 [auto1.nl] INFO: Found listing with ID: UY50656
2026-03-29 12:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UY50656%27 HTTP/1.1" 200 None
2026-03-29 12:01:11 [auto1.nl] INFO: Scrape type for UY50656: 0
2026-03-29 12:01:11 [auto1.nl] INFO: Found listing with ID: AM07460
2026-03-29 12:01:11 [auto1.nl] INFO: Found listing with ID: CP77095
2026-03-29 12:01:11 [auto1.nl] INFO: Found listing with ID: SA65575
2026-03-29 12:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SA65575%27 HTTP/1.1" 200 None
2026-03-29 12:01:11 [auto1.nl] INFO: Scrape type for SA65575: 0
2026-03-29 12:01:11 [auto1.nl] INFO: Found listing with ID: FC64695
2026-03-29 12:01:11 [auto1.nl] INFO: Found listing with ID: LS97590
2026-03-29 12:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LS97590%27 HTTP/1.1" 200 None
2026-03-29 12:01:11 [auto1.nl] INFO: Scrape type for LS97590: 0
2026-03-29 12:01:11 [auto1.nl] INFO: Found listing with ID: HX62169
2026-03-29 12:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HX62169%27 HTTP/1.1" 200 None
2026-03-29 12:01:11 [auto1.nl] INFO: Scrape type for HX62169: 0
2026-03-29 12:01:11 [auto1.nl] INFO: Found listing with ID: XY26028
2026-03-29 12:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XY26028%27 HTTP/1.1" 200 None
2026-03-29 12:01:11 [auto1.nl] INFO: Scrape type for XY26028: 0
2026-03-29 12:01:11 [auto1.nl] INFO: Found listing with ID: FE91435
2026-03-29 12:01:11 [auto1.nl] INFO: Found listing with ID: RY51498
2026-03-29 12:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RY51498%27 HTTP/1.1" 200 None
2026-03-29 12:01:11 [auto1.nl] INFO: Scrape type for RY51498: 0
2026-03-29 12:01:11 [auto1.nl] INFO: Found listing with ID: VC22580
2026-03-29 12:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VC22580%27 HTTP/1.1" 200 None
2026-03-29 12:01:11 [auto1.nl] INFO: Scrape type for VC22580: 0
2026-03-29 12:01:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 12:01:13 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 12:01:13 [auto1.nl] INFO: Channel: 24h | Page: 13 | totalHits: 759 | hits on page: 40
2026-03-29 12:01:13 [auto1.nl] INFO: Found listing with ID: SD85786
2026-03-29 12:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SD85786%27 HTTP/1.1" 200 None
2026-03-29 12:01:13 [auto1.nl] INFO: Scrape type for SD85786: 0
2026-03-29 12:01:13 [auto1.nl] INFO: Found listing with ID: HR88481
2026-03-29 12:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HR88481%27 HTTP/1.1" 200 None
2026-03-29 12:01:13 [auto1.nl] INFO: Scrape type for HR88481: 0
2026-03-29 12:01:13 [auto1.nl] INFO: Found listing with ID: MP21910
2026-03-29 12:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MP21910%27 HTTP/1.1" 200 None
2026-03-29 12:01:13 [auto1.nl] INFO: Scrape type for MP21910: 0
2026-03-29 12:01:13 [auto1.nl] INFO: Found listing with ID: KP34214
2026-03-29 12:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KP34214%27 HTTP/1.1" 200 None
2026-03-29 12:01:13 [auto1.nl] INFO: Scrape type for KP34214: 0
2026-03-29 12:01:13 [auto1.nl] INFO: Found listing with ID: TC15988
2026-03-29 12:01:13 [auto1.nl] INFO: Found listing with ID: SL12489
2026-03-29 12:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SL12489%27 HTTP/1.1" 200 None
2026-03-29 12:01:13 [auto1.nl] INFO: Scrape type for SL12489: 0
2026-03-29 12:01:13 [auto1.nl] INFO: Found listing with ID: PB89826
2026-03-29 12:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PB89826%27 HTTP/1.1" 200 None
2026-03-29 12:01:13 [auto1.nl] INFO: Scrape type for PB89826: 0
2026-03-29 12:01:13 [auto1.nl] INFO: Found listing with ID: WJ55319
2026-03-29 12:01:13 [auto1.nl] INFO: Found listing with ID: XV86348
2026-03-29 12:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XV86348%27 HTTP/1.1" 200 None
2026-03-29 12:01:13 [auto1.nl] INFO: Scrape type for XV86348: 0
2026-03-29 12:01:13 [auto1.nl] INFO: Found listing with ID: HK90585
2026-03-29 12:01:13 [auto1.nl] INFO: Found listing with ID: RY20438
2026-03-29 12:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RY20438%27 HTTP/1.1" 200 None
2026-03-29 12:01:13 [auto1.nl] INFO: Scrape type for RY20438: 0
2026-03-29 12:01:13 [auto1.nl] INFO: Found listing with ID: JC34887
2026-03-29 12:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JC34887%27 HTTP/1.1" 200 None
2026-03-29 12:01:13 [auto1.nl] INFO: Scrape type for JC34887: 0
2026-03-29 12:01:13 [auto1.nl] INFO: Found listing with ID: BN97277
2026-03-29 12:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BN97277%27 HTTP/1.1" 200 None
2026-03-29 12:01:13 [auto1.nl] INFO: Scrape type for BN97277: 0
2026-03-29 12:01:13 [auto1.nl] INFO: Found listing with ID: FD20387
2026-03-29 12:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FD20387%27 HTTP/1.1" 200 None
2026-03-29 12:01:13 [auto1.nl] INFO: Scrape type for FD20387: 0
2026-03-29 12:01:13 [auto1.nl] INFO: Found listing with ID: NF42307
2026-03-29 12:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NF42307%27 HTTP/1.1" 200 None
2026-03-29 12:01:13 [auto1.nl] INFO: Scrape type for NF42307: 0
2026-03-29 12:01:13 [auto1.nl] INFO: Found listing with ID: AA56023
2026-03-29 12:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AA56023%27 HTTP/1.1" 200 None
2026-03-29 12:01:13 [auto1.nl] INFO: Scrape type for AA56023: 0
2026-03-29 12:01:13 [auto1.nl] INFO: Found listing with ID: FB20368
2026-03-29 12:01:13 [auto1.nl] INFO: Found listing with ID: UA44354
2026-03-29 12:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UA44354%27 HTTP/1.1" 200 None
2026-03-29 12:01:13 [auto1.nl] INFO: Scrape type for UA44354: 0
2026-03-29 12:01:13 [auto1.nl] INFO: Found listing with ID: CT01963
2026-03-29 12:01:13 [auto1.nl] INFO: Found listing with ID: EG87315
2026-03-29 12:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EG87315%27 HTTP/1.1" 200 None
2026-03-29 12:01:13 [auto1.nl] INFO: Scrape type for EG87315: 0
2026-03-29 12:01:13 [auto1.nl] INFO: Found listing with ID: VB13156
2026-03-29 12:01:13 [auto1.nl] INFO: Found listing with ID: EB00697
2026-03-29 12:01:13 [auto1.nl] INFO: Found listing with ID: PN82428
2026-03-29 12:01:13 [auto1.nl] INFO: Found listing with ID: YR49127
2026-03-29 12:01:13 [auto1.nl] INFO: Found listing with ID: KV59291
2026-03-29 12:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KV59291%27 HTTP/1.1" 200 None
2026-03-29 12:01:13 [auto1.nl] INFO: Scrape type for KV59291: 0
2026-03-29 12:01:13 [auto1.nl] INFO: Found listing with ID: RT17278
2026-03-29 12:01:13 [auto1.nl] INFO: Found listing with ID: WZ30415
2026-03-29 12:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WZ30415%27 HTTP/1.1" 200 None
2026-03-29 12:01:13 [auto1.nl] INFO: Scrape type for WZ30415: 0
2026-03-29 12:01:13 [auto1.nl] INFO: Found listing with ID: WC97739
2026-03-29 12:01:13 [auto1.nl] INFO: Found listing with ID: BP06390
2026-03-29 12:01:13 [auto1.nl] INFO: Found listing with ID: CY67010
2026-03-29 12:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CY67010%27 HTTP/1.1" 200 None
2026-03-29 12:01:13 [auto1.nl] INFO: Scrape type for CY67010: 0
2026-03-29 12:01:13 [auto1.nl] INFO: Found listing with ID: GD14705
2026-03-29 12:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GD14705%27 HTTP/1.1" 200 None
2026-03-29 12:01:13 [auto1.nl] INFO: Scrape type for GD14705: 0
2026-03-29 12:01:13 [auto1.nl] INFO: Found listing with ID: VB96147
2026-03-29 12:01:13 [auto1.nl] INFO: Found listing with ID: LW98869
2026-03-29 12:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LW98869%27 HTTP/1.1" 200 None
2026-03-29 12:01:13 [auto1.nl] INFO: Scrape type for LW98869: 0
2026-03-29 12:01:13 [auto1.nl] INFO: Found listing with ID: TA38332
2026-03-29 12:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TA38332%27 HTTP/1.1" 200 None
2026-03-29 12:01:13 [auto1.nl] INFO: Scrape type for TA38332: 0
2026-03-29 12:01:13 [auto1.nl] INFO: Found listing with ID: DW43709
2026-03-29 12:01:13 [auto1.nl] INFO: Found listing with ID: SM08260
2026-03-29 12:01:13 [auto1.nl] INFO: Found listing with ID: PZ30163
2026-03-29 12:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PZ30163%27 HTTP/1.1" 200 None
2026-03-29 12:01:13 [auto1.nl] INFO: Scrape type for PZ30163: 0
2026-03-29 12:01:13 [auto1.nl] INFO: Found listing with ID: JP82620
2026-03-29 12:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JP82620%27 HTTP/1.1" 200 None
2026-03-29 12:01:13 [auto1.nl] INFO: Scrape type for JP82620: 0
2026-03-29 12:01:13 [auto1.nl] INFO: Found listing with ID: ZR54060
2026-03-29 12:01:13 [auto1.nl] INFO: Found listing with ID: TP38124
2026-03-29 12:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TP38124%27 HTTP/1.1" 200 None
2026-03-29 12:01:13 [auto1.nl] INFO: Scrape type for TP38124: 0
2026-03-29 12:01:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 12:01:15 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 12:01:15 [auto1.nl] INFO: Channel: 24h | Page: 14 | totalHits: 759 | hits on page: 40
2026-03-29 12:01:15 [auto1.nl] INFO: Found listing with ID: ZA96365
2026-03-29 12:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZA96365%27 HTTP/1.1" 200 None
2026-03-29 12:01:15 [auto1.nl] INFO: Scrape type for ZA96365: 0
2026-03-29 12:01:15 [auto1.nl] INFO: Found listing with ID: BH50437
2026-03-29 12:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BH50437%27 HTTP/1.1" 200 None
2026-03-29 12:01:15 [auto1.nl] INFO: Scrape type for BH50437: 0
2026-03-29 12:01:15 [auto1.nl] INFO: Found listing with ID: AB34968
2026-03-29 12:01:15 [auto1.nl] INFO: Found listing with ID: WP75740
2026-03-29 12:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WP75740%27 HTTP/1.1" 200 None
2026-03-29 12:01:15 [auto1.nl] INFO: Scrape type for WP75740: 0
2026-03-29 12:01:15 [auto1.nl] INFO: Found listing with ID: WE00434
2026-03-29 12:01:15 [auto1.nl] INFO: Found listing with ID: SZ87293
2026-03-29 12:01:15 [auto1.nl] INFO: Found listing with ID: CX26987
2026-03-29 12:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CX26987%27 HTTP/1.1" 200 None
2026-03-29 12:01:15 [auto1.nl] INFO: Scrape type for CX26987: 0
2026-03-29 12:01:15 [auto1.nl] INFO: Found listing with ID: SY05694
2026-03-29 12:01:15 [auto1.nl] INFO: Found listing with ID: HX39878
2026-03-29 12:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HX39878%27 HTTP/1.1" 200 None
2026-03-29 12:01:15 [auto1.nl] INFO: Scrape type for HX39878: 0
2026-03-29 12:01:15 [auto1.nl] INFO: Found listing with ID: GL61326
2026-03-29 12:01:15 [auto1.nl] INFO: Found listing with ID: CD92062
2026-03-29 12:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CD92062%27 HTTP/1.1" 200 None
2026-03-29 12:01:15 [auto1.nl] INFO: Scrape type for CD92062: 0
2026-03-29 12:01:15 [auto1.nl] INFO: Found listing with ID: YB51800
2026-03-29 12:01:15 [auto1.nl] INFO: Found listing with ID: TP84646
2026-03-29 12:01:15 [auto1.nl] INFO: Found listing with ID: UF96545
2026-03-29 12:01:15 [auto1.nl] INFO: Found listing with ID: EY58020
2026-03-29 12:01:15 [auto1.nl] INFO: Found listing with ID: SG32295
2026-03-29 12:01:15 [auto1.nl] INFO: Found listing with ID: TJ11018
2026-03-29 12:01:15 [auto1.nl] INFO: Found listing with ID: HT40495
2026-03-29 12:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HT40495%27 HTTP/1.1" 200 None
2026-03-29 12:01:15 [auto1.nl] INFO: Scrape type for HT40495: 0
2026-03-29 12:01:15 [auto1.nl] INFO: Found listing with ID: WY03082
2026-03-29 12:01:15 [auto1.nl] INFO: Found listing with ID: JJ92825
2026-03-29 12:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JJ92825%27 HTTP/1.1" 200 None
2026-03-29 12:01:15 [auto1.nl] INFO: Scrape type for JJ92825: 0
2026-03-29 12:01:15 [auto1.nl] INFO: Found listing with ID: EU67961
2026-03-29 12:01:15 [auto1.nl] INFO: Found listing with ID: FA26024
2026-03-29 12:01:15 [auto1.nl] INFO: Found listing with ID: TH29476
2026-03-29 12:01:15 [auto1.nl] INFO: Found listing with ID: TU99712
2026-03-29 12:01:15 [auto1.nl] INFO: Found listing with ID: WR76222
2026-03-29 12:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WR76222%27 HTTP/1.1" 200 None
2026-03-29 12:01:15 [auto1.nl] INFO: Scrape type for WR76222: 0
2026-03-29 12:01:15 [auto1.nl] INFO: Found listing with ID: BX66014
2026-03-29 12:01:15 [auto1.nl] INFO: Found listing with ID: XY00413
2026-03-29 12:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XY00413%27 HTTP/1.1" 200 None
2026-03-29 12:01:15 [auto1.nl] INFO: Scrape type for XY00413: 0
2026-03-29 12:01:15 [auto1.nl] INFO: Found listing with ID: BB94394
2026-03-29 12:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BB94394%27 HTTP/1.1" 200 None
2026-03-29 12:01:15 [auto1.nl] INFO: Scrape type for BB94394: 0
2026-03-29 12:01:15 [auto1.nl] INFO: Found listing with ID: LA33547
2026-03-29 12:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LA33547%27 HTTP/1.1" 200 None
2026-03-29 12:01:15 [auto1.nl] INFO: Scrape type for LA33547: 0
2026-03-29 12:01:15 [auto1.nl] INFO: Found listing with ID: UT96124
2026-03-29 12:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UT96124%27 HTTP/1.1" 200 None
2026-03-29 12:01:15 [auto1.nl] INFO: Scrape type for UT96124: 0
2026-03-29 12:01:15 [auto1.nl] INFO: Found listing with ID: BC50110
2026-03-29 12:01:15 [auto1.nl] INFO: Found listing with ID: MX73700
2026-03-29 12:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MX73700%27 HTTP/1.1" 200 None
2026-03-29 12:01:15 [auto1.nl] INFO: Scrape type for MX73700: 0
2026-03-29 12:01:15 [auto1.nl] INFO: Found listing with ID: VC54517
2026-03-29 12:01:15 [auto1.nl] INFO: Found listing with ID: KW64079
2026-03-29 12:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KW64079%27 HTTP/1.1" 200 None
2026-03-29 12:01:15 [auto1.nl] INFO: Scrape type for KW64079: 0
2026-03-29 12:01:15 [auto1.nl] INFO: Found listing with ID: BY11680
2026-03-29 12:01:15 [auto1.nl] INFO: Found listing with ID: GV91252
2026-03-29 12:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GV91252%27 HTTP/1.1" 200 None
2026-03-29 12:01:15 [auto1.nl] INFO: Scrape type for GV91252: 0
2026-03-29 12:01:15 [auto1.nl] INFO: Found listing with ID: VC21131
2026-03-29 12:01:15 [auto1.nl] INFO: Found listing with ID: UR81542
2026-03-29 12:01:15 [auto1.nl] INFO: Found listing with ID: VE70887
2026-03-29 12:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VE70887%27 HTTP/1.1" 200 None
2026-03-29 12:01:15 [auto1.nl] INFO: Scrape type for VE70887: 0
2026-03-29 12:01:15 [auto1.nl] INFO: Found listing with ID: BR03129
2026-03-29 12:01:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 12:01:16 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 12:01:16 [auto1.nl] INFO: Channel: 24h | Page: 15 | totalHits: 759 | hits on page: 40
2026-03-29 12:01:16 [auto1.nl] INFO: Found listing with ID: XP28763
2026-03-29 12:01:16 [auto1.nl] INFO: Found listing with ID: TY41517
2026-03-29 12:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TY41517%27 HTTP/1.1" 200 None
2026-03-29 12:01:16 [auto1.nl] INFO: Scrape type for TY41517: 0
2026-03-29 12:01:17 [auto1.nl] INFO: Found listing with ID: HL62659
2026-03-29 12:01:17 [auto1.nl] INFO: Found listing with ID: MF69205
2026-03-29 12:01:17 [auto1.nl] INFO: Found listing with ID: WP58537
2026-03-29 12:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WP58537%27 HTTP/1.1" 200 None
2026-03-29 12:01:17 [auto1.nl] INFO: Scrape type for WP58537: 0
2026-03-29 12:01:17 [auto1.nl] INFO: Found listing with ID: LE21715
2026-03-29 12:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LE21715%27 HTTP/1.1" 200 None
2026-03-29 12:01:17 [auto1.nl] INFO: Scrape type for LE21715: 0
2026-03-29 12:01:17 [auto1.nl] INFO: Found listing with ID: DH69810
2026-03-29 12:01:17 [auto1.nl] INFO: Found listing with ID: JH71745
2026-03-29 12:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JH71745%27 HTTP/1.1" 200 None
2026-03-29 12:01:17 [auto1.nl] INFO: Scrape type for JH71745: 0
2026-03-29 12:01:17 [auto1.nl] INFO: Found listing with ID: BL89669
2026-03-29 12:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BL89669%27 HTTP/1.1" 200 None
2026-03-29 12:01:17 [auto1.nl] INFO: Scrape type for BL89669: 0
2026-03-29 12:01:17 [auto1.nl] INFO: Found listing with ID: DB68589
2026-03-29 12:01:17 [auto1.nl] INFO: Found listing with ID: HN54837
2026-03-29 12:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HN54837%27 HTTP/1.1" 200 None
2026-03-29 12:01:17 [auto1.nl] INFO: Scrape type for HN54837: 0
2026-03-29 12:01:17 [auto1.nl] INFO: Found listing with ID: WG42782
2026-03-29 12:01:17 [auto1.nl] INFO: Found listing with ID: RF41961
2026-03-29 12:01:17 [auto1.nl] INFO: Found listing with ID: BC40672
2026-03-29 12:01:17 [auto1.nl] INFO: Found listing with ID: PR08670
2026-03-29 12:01:17 [auto1.nl] INFO: Found listing with ID: XK63885
2026-03-29 12:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XK63885%27 HTTP/1.1" 200 None
2026-03-29 12:01:17 [auto1.nl] INFO: Scrape type for XK63885: 0
2026-03-29 12:01:17 [auto1.nl] INFO: Found listing with ID: BJ61509
2026-03-29 12:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BJ61509%27 HTTP/1.1" 200 None
2026-03-29 12:01:17 [auto1.nl] INFO: Scrape type for BJ61509: 0
2026-03-29 12:01:17 [auto1.nl] INFO: Found listing with ID: RH72913
2026-03-29 12:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RH72913%27 HTTP/1.1" 200 None
2026-03-29 12:01:17 [auto1.nl] INFO: Scrape type for RH72913: 0
2026-03-29 12:01:17 [auto1.nl] INFO: Found listing with ID: SR45817
2026-03-29 12:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SR45817%27 HTTP/1.1" 200 None
2026-03-29 12:01:17 [auto1.nl] INFO: Scrape type for SR45817: 0
2026-03-29 12:01:17 [auto1.nl] INFO: Found listing with ID: DR36555
2026-03-29 12:01:17 [auto1.nl] INFO: Found listing with ID: BZ98625
2026-03-29 12:01:17 [auto1.nl] INFO: Found listing with ID: GM68754
2026-03-29 12:01:17 [auto1.nl] INFO: Found listing with ID: EC40520
2026-03-29 12:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EC40520%27 HTTP/1.1" 200 None
2026-03-29 12:01:17 [auto1.nl] INFO: Scrape type for EC40520: 0
2026-03-29 12:01:17 [auto1.nl] INFO: Found listing with ID: LL30088
2026-03-29 12:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LL30088%27 HTTP/1.1" 200 None
2026-03-29 12:01:17 [auto1.nl] INFO: Scrape type for LL30088: 0
2026-03-29 12:01:17 [auto1.nl] INFO: Found listing with ID: JP71821
2026-03-29 12:01:17 [auto1.nl] INFO: Found listing with ID: SN61945
2026-03-29 12:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SN61945%27 HTTP/1.1" 200 None
2026-03-29 12:01:17 [auto1.nl] INFO: Scrape type for SN61945: 0
2026-03-29 12:01:17 [auto1.nl] INFO: Found listing with ID: BG04233
2026-03-29 12:01:17 [auto1.nl] INFO: Found listing with ID: ZK31432
2026-03-29 12:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZK31432%27 HTTP/1.1" 200 None
2026-03-29 12:01:17 [auto1.nl] INFO: Scrape type for ZK31432: 0
2026-03-29 12:01:17 [auto1.nl] INFO: Found listing with ID: AT06250
2026-03-29 12:01:17 [auto1.nl] INFO: Found listing with ID: GN14496
2026-03-29 12:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GN14496%27 HTTP/1.1" 200 None
2026-03-29 12:01:17 [auto1.nl] INFO: Scrape type for GN14496: 0
2026-03-29 12:01:17 [auto1.nl] INFO: Found listing with ID: WH58354
2026-03-29 12:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WH58354%27 HTTP/1.1" 200 None
2026-03-29 12:01:17 [auto1.nl] INFO: Scrape type for WH58354: 0
2026-03-29 12:01:17 [auto1.nl] INFO: Found listing with ID: VZ88435
2026-03-29 12:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VZ88435%27 HTTP/1.1" 200 None
2026-03-29 12:01:17 [auto1.nl] INFO: Scrape type for VZ88435: 0
2026-03-29 12:01:17 [auto1.nl] INFO: Found listing with ID: ZK58084
2026-03-29 12:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZK58084%27 HTTP/1.1" 200 None
2026-03-29 12:01:17 [auto1.nl] INFO: Scrape type for ZK58084: 0
2026-03-29 12:01:17 [auto1.nl] INFO: Found listing with ID: ZN70459
2026-03-29 12:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZN70459%27 HTTP/1.1" 200 None
2026-03-29 12:01:17 [auto1.nl] INFO: Scrape type for ZN70459: 0
2026-03-29 12:01:17 [auto1.nl] INFO: Found listing with ID: JW17706
2026-03-29 12:01:17 [auto1.nl] INFO: Found listing with ID: GU81834
2026-03-29 12:01:17 [auto1.nl] INFO: Found listing with ID: BC15859
2026-03-29 12:01:17 [auto1.nl] INFO: Found listing with ID: XR27425
2026-03-29 12:01:17 [auto1.nl] INFO: Found listing with ID: ME79677
2026-03-29 12:01:17 [auto1.nl] INFO: Found listing with ID: FE67699
2026-03-29 12:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FE67699%27 HTTP/1.1" 200 None
2026-03-29 12:01:17 [auto1.nl] INFO: Scrape type for FE67699: 0
2026-03-29 12:01:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 12:01:18 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 12:01:18 [auto1.nl] INFO: Channel: 24h | Page: 16 | totalHits: 759 | hits on page: 40
2026-03-29 12:01:18 [auto1.nl] INFO: Found listing with ID: XU82529
2026-03-29 12:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XU82529%27 HTTP/1.1" 200 None
2026-03-29 12:01:18 [auto1.nl] INFO: Scrape type for XU82529: 0
2026-03-29 12:01:18 [auto1.nl] INFO: Found listing with ID: PT04530
2026-03-29 12:01:18 [auto1.nl] INFO: Found listing with ID: VZ65695
2026-03-29 12:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VZ65695%27 HTTP/1.1" 200 None
2026-03-29 12:01:18 [auto1.nl] INFO: Scrape type for VZ65695: 0
2026-03-29 12:01:18 [auto1.nl] INFO: Found listing with ID: GU70185
2026-03-29 12:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GU70185%27 HTTP/1.1" 200 None
2026-03-29 12:01:18 [auto1.nl] INFO: Scrape type for GU70185: 0
2026-03-29 12:01:18 [auto1.nl] INFO: Found listing with ID: PS03610
2026-03-29 12:01:18 [auto1.nl] INFO: Found listing with ID: GD33520
2026-03-29 12:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GD33520%27 HTTP/1.1" 200 None
2026-03-29 12:01:18 [auto1.nl] INFO: Scrape type for GD33520: 0
2026-03-29 12:01:18 [auto1.nl] INFO: Found listing with ID: MD18286
2026-03-29 12:01:18 [auto1.nl] INFO: Found listing with ID: PS01910
2026-03-29 12:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PS01910%27 HTTP/1.1" 200 None
2026-03-29 12:01:18 [auto1.nl] INFO: Scrape type for PS01910: 0
2026-03-29 12:01:18 [auto1.nl] INFO: Found listing with ID: EB08844
2026-03-29 12:01:18 [auto1.nl] INFO: Found listing with ID: AB54003
2026-03-29 12:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AB54003%27 HTTP/1.1" 200 None
2026-03-29 12:01:18 [auto1.nl] INFO: Scrape type for AB54003: 0
2026-03-29 12:01:18 [auto1.nl] INFO: Found listing with ID: HD36341
2026-03-29 12:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HD36341%27 HTTP/1.1" 200 None
2026-03-29 12:01:18 [auto1.nl] INFO: Scrape type for HD36341: 0
2026-03-29 12:01:18 [auto1.nl] INFO: Found listing with ID: PV55742
2026-03-29 12:01:18 [auto1.nl] INFO: Found listing with ID: JA81822
2026-03-29 12:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JA81822%27 HTTP/1.1" 200 None
2026-03-29 12:01:18 [auto1.nl] INFO: Scrape type for JA81822: 0
2026-03-29 12:01:18 [auto1.nl] INFO: Found listing with ID: AM51490
2026-03-29 12:01:18 [auto1.nl] INFO: Found listing with ID: JA39510
2026-03-29 12:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JA39510%27 HTTP/1.1" 200 None
2026-03-29 12:01:18 [auto1.nl] INFO: Scrape type for JA39510: 0
2026-03-29 12:01:18 [auto1.nl] INFO: Found listing with ID: AD33035
2026-03-29 12:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AD33035%27 HTTP/1.1" 200 None
2026-03-29 12:01:18 [auto1.nl] INFO: Scrape type for AD33035: 0
2026-03-29 12:01:18 [auto1.nl] INFO: Found listing with ID: MD35327
2026-03-29 12:01:18 [auto1.nl] INFO: Found listing with ID: NJ31093
2026-03-29 12:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NJ31093%27 HTTP/1.1" 200 None
2026-03-29 12:01:18 [auto1.nl] INFO: Scrape type for NJ31093: 0
2026-03-29 12:01:18 [auto1.nl] INFO: Found listing with ID: YZ13462
2026-03-29 12:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YZ13462%27 HTTP/1.1" 200 None
2026-03-29 12:01:18 [auto1.nl] INFO: Scrape type for YZ13462: 0
2026-03-29 12:01:18 [auto1.nl] INFO: Found listing with ID: LE06198
2026-03-29 12:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LE06198%27 HTTP/1.1" 200 None
2026-03-29 12:01:19 [auto1.nl] INFO: Scrape type for LE06198: 0
2026-03-29 12:01:19 [auto1.nl] INFO: Found listing with ID: TR09691
2026-03-29 12:01:19 [auto1.nl] INFO: Found listing with ID: HW32084
2026-03-29 12:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HW32084%27 HTTP/1.1" 200 None
2026-03-29 12:01:19 [auto1.nl] INFO: Scrape type for HW32084: 0
2026-03-29 12:01:19 [auto1.nl] INFO: Found listing with ID: KX19183
2026-03-29 12:01:19 [auto1.nl] INFO: Found listing with ID: EW29368
2026-03-29 12:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EW29368%27 HTTP/1.1" 200 None
2026-03-29 12:01:19 [auto1.nl] INFO: Scrape type for EW29368: 0
2026-03-29 12:01:19 [auto1.nl] INFO: Found listing with ID: UW56966
2026-03-29 12:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UW56966%27 HTTP/1.1" 200 None
2026-03-29 12:01:19 [auto1.nl] INFO: Scrape type for UW56966: 0
2026-03-29 12:01:19 [auto1.nl] INFO: Found listing with ID: JH24547
2026-03-29 12:01:19 [auto1.nl] INFO: Found listing with ID: HL97424
2026-03-29 12:01:19 [auto1.nl] INFO: Found listing with ID: YF94322
2026-03-29 12:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YF94322%27 HTTP/1.1" 200 None
2026-03-29 12:01:19 [auto1.nl] INFO: Scrape type for YF94322: 0
2026-03-29 12:01:19 [auto1.nl] INFO: Found listing with ID: AB85439
2026-03-29 12:01:19 [auto1.nl] INFO: Found listing with ID: PK76759
2026-03-29 12:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PK76759%27 HTTP/1.1" 200 None
2026-03-29 12:01:19 [auto1.nl] INFO: Scrape type for PK76759: 0
2026-03-29 12:01:19 [auto1.nl] INFO: Found listing with ID: UE65811
2026-03-29 12:01:19 [auto1.nl] INFO: Found listing with ID: UY86442
2026-03-29 12:01:19 [auto1.nl] INFO: Found listing with ID: WG90560
2026-03-29 12:01:19 [auto1.nl] INFO: Found listing with ID: GA63942
2026-03-29 12:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GA63942%27 HTTP/1.1" 200 None
2026-03-29 12:01:19 [auto1.nl] INFO: Scrape type for GA63942: 2
2026-03-29 12:01:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a812abb7-90f9-58e3-b4be-ec9a14d651d5 with identifier: GA63942
2026-03-29 12:01:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a812abb7-90f9-58e3-b4be-ec9a14d651d5 with scrape type 2
2026-03-29 12:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a812abb7-90f9-58e3-b4be-ec9a14d651d5 with scrape type 2
2026-03-29 12:01:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: a812abb7-90f9-58e3-b4be-ec9a14d651d5, identifier: GA63942
2026-03-29 12:01:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: a812abb7-90f9-58e3-b4be-ec9a14d651d5 with identifier: GA63942
2026-03-29 12:01:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: a812abb7-90f9-58e3-b4be-ec9a14d651d5 with identifier: GA63942
2026-03-29 12:01:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: a812abb7-90f9-58e3-b4be-ec9a14d651d5 with identifier: GA63942 to the API
2026-03-29 12:01:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 12:01:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 12:01:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-30T15:04:19Z',
 'fuel_type': 'petrol',
 'id': 'a812abb7-90f9-58e3-b4be-ec9a14d651d5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GA63942',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'Qashqai',
 'odometer': 150632,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-12-01',
 'seller_name': None,
 'title': 'Nissan Qashqai 2.0 I-Way',
 'transmission': 'automatic',
 'trim': 'I-Way',
 'year': 2011}
2026-03-29 12:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GA63942%27 HTTP/1.1" 200 None
2026-03-29 12:01:19 [auto1.nl] INFO: Saving data for GA63942: {'auction_closing_time': 1774883059.0, 'created_time': 1774699233.180321, 'last_price_update_time': 1774785679.63931}
2026-03-29 12:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='GA63942') HTTP/1.1" 204 0
2026-03-29 12:01:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 12:01:19 [auto1.nl] INFO: Found listing with ID: XH80509
2026-03-29 12:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XH80509%27 HTTP/1.1" 200 None
2026-03-29 12:01:19 [auto1.nl] INFO: Scrape type for XH80509: 0
2026-03-29 12:01:19 [auto1.nl] INFO: Found listing with ID: ND88147
2026-03-29 12:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ND88147%27 HTTP/1.1" 200 None
2026-03-29 12:01:19 [auto1.nl] INFO: Scrape type for ND88147: 2
2026-03-29 12:01:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 387baa92-9d7d-52d8-ab82-6a055485c20b with identifier: ND88147
2026-03-29 12:01:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 387baa92-9d7d-52d8-ab82-6a055485c20b with scrape type 2
2026-03-29 12:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 387baa92-9d7d-52d8-ab82-6a055485c20b with scrape type 2
2026-03-29 12:01:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 387baa92-9d7d-52d8-ab82-6a055485c20b, identifier: ND88147
2026-03-29 12:01:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 387baa92-9d7d-52d8-ab82-6a055485c20b with identifier: ND88147
2026-03-29 12:01:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-29 12:01:19 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=violet HTTP/1.1" 200 None
2026-03-29 12:01:19 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-29 12:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-29 12:01:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 387baa92-9d7d-52d8-ab82-6a055485c20b with identifier: ND88147
2026-03-29 12:01:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 387baa92-9d7d-52d8-ab82-6a055485c20b with identifier: ND88147 to the API
2026-03-29 12:01:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 12:01:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 12:01:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'violet',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-30T15:20:33Z',
 'fuel_type': 'petrol',
 'id': '387baa92-9d7d-52d8-ab82-6a055485c20b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ND88147',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'C-Max',
 'odometer': 271602,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-12-30',
 'seller_name': None,
 'title': 'Ford C-Max 1.6 Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2008}
2026-03-29 12:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ND88147%27 HTTP/1.1" 200 None
2026-03-29 12:01:20 [auto1.nl] INFO: Saving data for ND88147: {'auction_closing_time': 1774884033.0, 'created_time': 1774699235.579411, 'last_price_update_time': 1774785680.258618}
2026-03-29 12:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='ND88147') HTTP/1.1" 204 0
2026-03-29 12:01:20 [auto1.nl] INFO: Found listing with ID: UR39080
2026-03-29 12:01:20 [auto1.nl] INFO: Found listing with ID: WE18316
2026-03-29 12:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WE18316%27 HTTP/1.1" 200 None
2026-03-29 12:01:20 [auto1.nl] INFO: Scrape type for WE18316: 0
2026-03-29 12:01:20 [auto1.nl] INFO: Found listing with ID: SS74343
2026-03-29 12:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SS74343%27 HTTP/1.1" 200 None
2026-03-29 12:01:20 [auto1.nl] INFO: Scrape type for SS74343: 0
2026-03-29 12:01:20 [auto1.nl] INFO: Found listing with ID: YZ60467
2026-03-29 12:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YZ60467%27 HTTP/1.1" 200 None
2026-03-29 12:01:20 [auto1.nl] INFO: Scrape type for YZ60467: 2
2026-03-29 12:01:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 348a5638-421f-592d-9f06-e9ad8871cc4f with identifier: YZ60467
2026-03-29 12:01:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 348a5638-421f-592d-9f06-e9ad8871cc4f with scrape type 2
2026-03-29 12:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 348a5638-421f-592d-9f06-e9ad8871cc4f with scrape type 2
2026-03-29 12:01:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 348a5638-421f-592d-9f06-e9ad8871cc4f, identifier: YZ60467
2026-03-29 12:01:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 348a5638-421f-592d-9f06-e9ad8871cc4f with identifier: YZ60467
2026-03-29 12:01:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 348a5638-421f-592d-9f06-e9ad8871cc4f with identifier: YZ60467
2026-03-29 12:01:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 348a5638-421f-592d-9f06-e9ad8871cc4f with identifier: YZ60467 to the API
2026-03-29 12:01:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 12:01:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 12:01:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 80,
 'expiration_date': '2026-03-30T15:18:54Z',
 'fuel_type': 'petrol',
 'id': '348a5638-421f-592d-9f06-e9ad8871cc4f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YZ60467',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'Micra',
 'odometer': 59795,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-06-23',
 'seller_name': None,
 'title': 'Nissan Micra 1.2 Acenta',
 'transmission': 'automatic',
 'trim': 'Acenta',
 'year': 2015}
2026-03-29 12:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YZ60467%27 HTTP/1.1" 200 None
2026-03-29 12:01:20 [auto1.nl] INFO: Saving data for YZ60467: {'auction_closing_time': 1774883934.0, 'created_time': 1774699266.66846, 'last_price_update_time': 1774785680.696046}
2026-03-29 12:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='YZ60467') HTTP/1.1" 204 0
2026-03-29 12:01:22 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 12:01:22 [auto1.nl] INFO: Channel: 24h | Page: 17 | totalHits: 759 | hits on page: 40
2026-03-29 12:01:22 [auto1.nl] INFO: Found listing with ID: MZ09465
2026-03-29 12:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MZ09465%27 HTTP/1.1" 200 None
2026-03-29 12:01:22 [auto1.nl] INFO: Scrape type for MZ09465: 0
2026-03-29 12:01:22 [auto1.nl] INFO: Found listing with ID: EG04578
2026-03-29 12:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EG04578%27 HTTP/1.1" 200 None
2026-03-29 12:01:22 [auto1.nl] INFO: Scrape type for EG04578: 0
2026-03-29 12:01:22 [auto1.nl] INFO: Found listing with ID: PH88105
2026-03-29 12:01:22 [auto1.nl] INFO: Found listing with ID: UF12505
2026-03-29 12:01:22 [auto1.nl] INFO: Found listing with ID: PJ49676
2026-03-29 12:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PJ49676%27 HTTP/1.1" 200 None
2026-03-29 12:01:22 [auto1.nl] INFO: Scrape type for PJ49676: 2
2026-03-29 12:01:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 91a98ae1-87c8-5da9-b298-6807c53e5094 with identifier: PJ49676
2026-03-29 12:01:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 91a98ae1-87c8-5da9-b298-6807c53e5094 with scrape type 2
2026-03-29 12:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 91a98ae1-87c8-5da9-b298-6807c53e5094 with scrape type 2
2026-03-29 12:01:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 91a98ae1-87c8-5da9-b298-6807c53e5094, identifier: PJ49676
2026-03-29 12:01:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 91a98ae1-87c8-5da9-b298-6807c53e5094 with identifier: PJ49676
2026-03-29 12:01:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 91a98ae1-87c8-5da9-b298-6807c53e5094 with identifier: PJ49676
2026-03-29 12:01:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 91a98ae1-87c8-5da9-b298-6807c53e5094 with identifier: PJ49676 to the API
2026-03-29 12:01:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 12:01:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 12:01:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 205,
 'expiration_date': '2026-03-30T15:03:20Z',
 'fuel_type': 'diesel',
 'id': '91a98ae1-87c8-5da9-b298-6807c53e5094',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PJ49676',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'E-Klasse',
 'odometer': 231536,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2003-03-05',
 'seller_name': None,
 'title': 'Mercedes-Benz E-Klasse E 320 CDI Avantgarde',
 'transmission': 'automatic',
 'trim': 'Avantgarde',
 'year': 2003}
2026-03-29 12:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PJ49676%27 HTTP/1.1" 200 None
2026-03-29 12:01:23 [auto1.nl] INFO: Saving data for PJ49676: {'auction_closing_time': 1774883000.0, 'created_time': 1774008047.136506, 'last_price_update_time': 1774785683.187603}
2026-03-29 12:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='PJ49676') HTTP/1.1" 204 0
2026-03-29 12:01:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 12:01:23 [auto1.nl] INFO: Found listing with ID: XK28167
2026-03-29 12:01:23 [auto1.nl] INFO: Found listing with ID: JC30911
2026-03-29 12:01:23 [auto1.nl] INFO: Found listing with ID: AX92237
2026-03-29 12:01:23 [auto1.nl] INFO: Found listing with ID: TL29950
2026-03-29 12:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TL29950%27 HTTP/1.1" 200 None
2026-03-29 12:01:23 [auto1.nl] INFO: Scrape type for TL29950: 0
2026-03-29 12:01:23 [auto1.nl] INFO: Found listing with ID: UB73502
2026-03-29 12:01:23 [auto1.nl] INFO: Found listing with ID: TP02076
2026-03-29 12:01:23 [auto1.nl] INFO: Found listing with ID: GZ48867
2026-03-29 12:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GZ48867%27 HTTP/1.1" 200 None
2026-03-29 12:01:23 [auto1.nl] INFO: Scrape type for GZ48867: 2
2026-03-29 12:01:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0c87a53e-b4c9-587f-b08f-930448a40f7d with identifier: GZ48867
2026-03-29 12:01:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0c87a53e-b4c9-587f-b08f-930448a40f7d with scrape type 2
2026-03-29 12:01:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0c87a53e-b4c9-587f-b08f-930448a40f7d with scrape type 2
2026-03-29 12:01:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 0c87a53e-b4c9-587f-b08f-930448a40f7d, identifier: GZ48867
2026-03-29 12:01:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 0c87a53e-b4c9-587f-b08f-930448a40f7d with identifier: GZ48867
2026-03-29 12:01:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 0c87a53e-b4c9-587f-b08f-930448a40f7d with identifier: GZ48867
2026-03-29 12:01:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 0c87a53e-b4c9-587f-b08f-930448a40f7d with identifier: GZ48867 to the API
2026-03-29 12:01:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 12:01:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 12:01:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 367,
 'expiration_date': '2026-03-30T15:15:52Z',
 'fuel_type': 'hybrid',
 'id': '0c87a53e-b4c9-587f-b08f-930448a40f7d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GZ48867',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q5 Sportback',
 'odometer': 117350,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-10-27',
 'seller_name': None,
 'title': 'Audi Q5 Sportback 55 TFSIe quattro S line',
 'transmission': 'automatic',
 'trim': 'quattro S line',
 'year': 2022}
2026-03-29 12:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GZ48867%27 HTTP/1.1" 200 None
2026-03-29 12:01:23 [auto1.nl] INFO: Saving data for GZ48867: {'auction_closing_time': 1774883752.0, 'created_time': 1774465315.20143, 'last_price_update_time': 1774785683.729183}
2026-03-29 12:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='GZ48867') HTTP/1.1" 204 0
2026-03-29 12:01:23 [auto1.nl] INFO: Found listing with ID: BV07887
2026-03-29 12:01:23 [auto1.nl] INFO: Found listing with ID: ZE09391
2026-03-29 12:01:23 [auto1.nl] INFO: Found listing with ID: ER86910
2026-03-29 12:01:23 [auto1.nl] INFO: Found listing with ID: ZB71006
2026-03-29 12:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZB71006%27 HTTP/1.1" 200 None
2026-03-29 12:01:23 [auto1.nl] INFO: Scrape type for ZB71006: 2
2026-03-29 12:01:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5333bba5-93d3-52c1-b6ec-9f61023e9919 with identifier: ZB71006
2026-03-29 12:01:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5333bba5-93d3-52c1-b6ec-9f61023e9919 with scrape type 2
2026-03-29 12:01:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5333bba5-93d3-52c1-b6ec-9f61023e9919 with scrape type 2
2026-03-29 12:01:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 5333bba5-93d3-52c1-b6ec-9f61023e9919, identifier: ZB71006
2026-03-29 12:01:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 5333bba5-93d3-52c1-b6ec-9f61023e9919 with identifier: ZB71006
2026-03-29 12:01:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 5333bba5-93d3-52c1-b6ec-9f61023e9919 with identifier: ZB71006
2026-03-29 12:01:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 5333bba5-93d3-52c1-b6ec-9f61023e9919 with identifier: ZB71006 to the API
2026-03-29 12:01:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 12:01:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 12:01:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 392,
 'expiration_date': '2026-03-30T15:10:44Z',
 'fuel_type': 'hybrid',
 'id': '5333bba5-93d3-52c1-b6ec-9f61023e9919',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZB71006',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'XC90',
 'odometer': 184309,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-11-09',
 'seller_name': None,
 'title': 'Volvo XC90 2.0 T8 Plug-in Hybrid Momentum AWD',
 'transmission': 'automatic',
 'trim': 'Momentum AWD',
 'year': 2016}
2026-03-29 12:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZB71006%27 HTTP/1.1" 200 None
2026-03-29 12:01:24 [auto1.nl] INFO: Saving data for ZB71006: {'auction_closing_time': 1774883444.0, 'created_time': 1774699267.979346, 'last_price_update_time': 1774785684.107739}
2026-03-29 12:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='ZB71006') HTTP/1.1" 204 0
2026-03-29 12:01:24 [auto1.nl] INFO: Found listing with ID: DR23359
2026-03-29 12:01:24 [auto1.nl] INFO: Found listing with ID: DU11939
2026-03-29 12:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DU11939%27 HTTP/1.1" 200 None
2026-03-29 12:01:24 [auto1.nl] INFO: Scrape type for DU11939: 0
2026-03-29 12:01:24 [auto1.nl] INFO: Found listing with ID: MH16372
2026-03-29 12:01:24 [auto1.nl] INFO: Found listing with ID: ME24209
2026-03-29 12:01:24 [auto1.nl] INFO: Found listing with ID: PU27111
2026-03-29 12:01:24 [auto1.nl] INFO: Found listing with ID: KK51574
2026-03-29 12:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KK51574%27 HTTP/1.1" 200 None
2026-03-29 12:01:24 [auto1.nl] INFO: Scrape type for KK51574: 2
2026-03-29 12:01:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1c961ab1-82f0-50e8-8c69-306cd09de1a7 with identifier: KK51574
2026-03-29 12:01:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1c961ab1-82f0-50e8-8c69-306cd09de1a7 with scrape type 2
2026-03-29 12:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1c961ab1-82f0-50e8-8c69-306cd09de1a7 with scrape type 2
2026-03-29 12:01:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 1c961ab1-82f0-50e8-8c69-306cd09de1a7, identifier: KK51574
2026-03-29 12:01:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 1c961ab1-82f0-50e8-8c69-306cd09de1a7 with identifier: KK51574
2026-03-29 12:01:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 1c961ab1-82f0-50e8-8c69-306cd09de1a7 with identifier: KK51574
2026-03-29 12:01:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 1c961ab1-82f0-50e8-8c69-306cd09de1a7 with identifier: KK51574 to the API
2026-03-29 12:01:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 12:01:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 12:01:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 67,
 'expiration_date': '2026-03-30T15:30:53Z',
 'fuel_type': 'petrol',
 'id': '1c961ab1-82f0-50e8-8c69-306cd09de1a7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KK51574',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'i10',
 'odometer': 125968,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-11-19',
 'seller_name': None,
 'title': 'Hyundai i10 1.1 Cool',
 'transmission': 'manual',
 'trim': 'Cool',
 'year': 2010}
2026-03-29 12:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KK51574%27 HTTP/1.1" 200 None
2026-03-29 12:01:24 [auto1.nl] INFO: Saving data for KK51574: {'auction_closing_time': 1774884653.0, 'created_time': 1774699264.702174, 'last_price_update_time': 1774785684.622544}
2026-03-29 12:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='KK51574') HTTP/1.1" 204 0
2026-03-29 12:01:24 [auto1.nl] INFO: Found listing with ID: AK27162
2026-03-29 12:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AK27162%27 HTTP/1.1" 200 None
2026-03-29 12:01:24 [auto1.nl] INFO: Scrape type for AK27162: 2
2026-03-29 12:01:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a29dff94-6ab8-5f78-aa8c-49d7297720b8 with identifier: AK27162
2026-03-29 12:01:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a29dff94-6ab8-5f78-aa8c-49d7297720b8 with scrape type 2
2026-03-29 12:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a29dff94-6ab8-5f78-aa8c-49d7297720b8 with scrape type 2
2026-03-29 12:01:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: a29dff94-6ab8-5f78-aa8c-49d7297720b8, identifier: AK27162
2026-03-29 12:01:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: a29dff94-6ab8-5f78-aa8c-49d7297720b8 with identifier: AK27162
2026-03-29 12:01:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: a29dff94-6ab8-5f78-aa8c-49d7297720b8 with identifier: AK27162
2026-03-29 12:01:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: a29dff94-6ab8-5f78-aa8c-49d7297720b8 with identifier: AK27162 to the API
2026-03-29 12:01:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 12:01:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 12:01:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 82,
 'expiration_date': '2026-03-30T15:56:17Z',
 'fuel_type': 'petrol',
 'id': 'a29dff94-6ab8-5f78-aa8c-49d7297720b8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AK27162',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C4 Cactus',
 'odometer': 162951,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-06-17',
 'seller_name': None,
 'title': 'Citroen C4 Cactus 1.2 VTi Feel',
 'transmission': 'manual',
 'trim': 'Feel',
 'year': 2015}
2026-03-29 12:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AK27162%27 HTTP/1.1" 200 None
2026-03-29 12:01:25 [auto1.nl] INFO: Saving data for AK27162: {'auction_closing_time': 1774886177.0, 'created_time': 1774699272.488038, 'last_price_update_time': 1774785685.052976}
2026-03-29 12:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='AK27162') HTTP/1.1" 204 0
2026-03-29 12:01:25 [auto1.nl] INFO: Found listing with ID: KX15971
2026-03-29 12:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KX15971%27 HTTP/1.1" 200 None
2026-03-29 12:01:25 [auto1.nl] INFO: Scrape type for KX15971: 2
2026-03-29 12:01:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 890261b5-6ca7-5909-a7a9-ad57bf3e6b54 with identifier: KX15971
2026-03-29 12:01:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 890261b5-6ca7-5909-a7a9-ad57bf3e6b54 with scrape type 2
2026-03-29 12:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 890261b5-6ca7-5909-a7a9-ad57bf3e6b54 with scrape type 2
2026-03-29 12:01:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 890261b5-6ca7-5909-a7a9-ad57bf3e6b54, identifier: KX15971
2026-03-29 12:01:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 890261b5-6ca7-5909-a7a9-ad57bf3e6b54 with identifier: KX15971
2026-03-29 12:01:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 890261b5-6ca7-5909-a7a9-ad57bf3e6b54 with identifier: KX15971
2026-03-29 12:01:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 890261b5-6ca7-5909-a7a9-ad57bf3e6b54 with identifier: KX15971 to the API
2026-03-29 12:01:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 12:01:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 12:01:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 68,
 'expiration_date': '2026-03-30T15:00:17Z',
 'fuel_type': 'petrol',
 'id': '890261b5-6ca7-5909-a7a9-ad57bf3e6b54',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KX15971',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C1',
 'odometer': 101873,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-02-28',
 'seller_name': None,
 'title': 'Citroen C1 1.0 Style',
 'transmission': 'manual',
 'trim': 'Style',
 'year': 2012}
2026-03-29 12:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KX15971%27 HTTP/1.1" 200 None
2026-03-29 12:01:25 [auto1.nl] INFO: Saving data for KX15971: {'auction_closing_time': 1774882817.0, 'created_time': 1774699265.217792, 'last_price_update_time': 1774785685.435045}
2026-03-29 12:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='KX15971') HTTP/1.1" 204 0
2026-03-29 12:01:25 [auto1.nl] INFO: Found listing with ID: MV10901
2026-03-29 12:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MV10901%27 HTTP/1.1" 200 None
2026-03-29 12:01:25 [auto1.nl] INFO: Scrape type for MV10901: 2
2026-03-29 12:01:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0bb5a2b7-df3a-5f0b-8db8-ed16c8e3c8c9 with identifier: MV10901
2026-03-29 12:01:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0bb5a2b7-df3a-5f0b-8db8-ed16c8e3c8c9 with scrape type 2
2026-03-29 12:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0bb5a2b7-df3a-5f0b-8db8-ed16c8e3c8c9 with scrape type 2
2026-03-29 12:01:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 0bb5a2b7-df3a-5f0b-8db8-ed16c8e3c8c9, identifier: MV10901
2026-03-29 12:01:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 0bb5a2b7-df3a-5f0b-8db8-ed16c8e3c8c9 with identifier: MV10901
2026-03-29 12:01:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 0bb5a2b7-df3a-5f0b-8db8-ed16c8e3c8c9 with identifier: MV10901
2026-03-29 12:01:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 0bb5a2b7-df3a-5f0b-8db8-ed16c8e3c8c9 with identifier: MV10901 to the API
2026-03-29 12:01:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 12:01:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 12:01:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-30T15:26:42Z',
 'fuel_type': 'diesel',
 'id': '0bb5a2b7-df3a-5f0b-8db8-ed16c8e3c8c9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MV10901',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Caddy',
 'odometer': 292618,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-12-11',
 'seller_name': None,
 'title': 'Volkswagen Caddy 1.6 TDI Kasten',
 'transmission': 'manual',
 'trim': 'Kasten',
 'year': 2014}
2026-03-29 12:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MV10901%27 HTTP/1.1" 200 None
2026-03-29 12:01:25 [auto1.nl] INFO: Saving data for MV10901: {'auction_closing_time': 1774884402.0, 'created_time': 1773861244.096813, 'last_price_update_time': 1774785685.829628}
2026-03-29 12:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='MV10901') HTTP/1.1" 204 0
2026-03-29 12:01:25 [auto1.nl] INFO: Found listing with ID: EH33258
2026-03-29 12:01:25 [auto1.nl] INFO: Found listing with ID: SE67800
2026-03-29 12:01:25 [auto1.nl] INFO: Found listing with ID: TN45594
2026-03-29 12:01:25 [auto1.nl] INFO: Found listing with ID: HK48702
2026-03-29 12:01:25 [auto1.nl] INFO: Found listing with ID: PX89333
2026-03-29 12:01:25 [auto1.nl] INFO: Found listing with ID: ZT51900
2026-03-29 12:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZT51900%27 HTTP/1.1" 200 None
2026-03-29 12:01:25 [auto1.nl] INFO: Scrape type for ZT51900: 2
2026-03-29 12:01:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 49421184-a919-54bd-8e77-7aa2fe6a62d1 with identifier: ZT51900
2026-03-29 12:01:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 49421184-a919-54bd-8e77-7aa2fe6a62d1 with scrape type 2
2026-03-29 12:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 49421184-a919-54bd-8e77-7aa2fe6a62d1 with scrape type 2
2026-03-29 12:01:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 49421184-a919-54bd-8e77-7aa2fe6a62d1, identifier: ZT51900
2026-03-29 12:01:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 49421184-a919-54bd-8e77-7aa2fe6a62d1 with identifier: ZT51900
2026-03-29 12:01:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 49421184-a919-54bd-8e77-7aa2fe6a62d1 with identifier: ZT51900
2026-03-29 12:01:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 49421184-a919-54bd-8e77-7aa2fe6a62d1 with identifier: ZT51900 to the API
2026-03-29 12:01:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 12:01:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 12:01:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 68,
 'expiration_date': '2026-03-30T15:00:52Z',
 'fuel_type': 'diesel',
 'id': '49421184-a919-54bd-8e77-7aa2fe6a62d1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZT51900',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Kangoo',
 'odometer': 249395,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-01-04',
 'seller_name': None,
 'title': 'Renault Kangoo 1.5 dCi Rapid Basis',
 'transmission': 'manual',
 'trim': 'Rapid Basis',
 'year': 2010}
2026-03-29 12:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZT51900%27 HTTP/1.1" 200 None
2026-03-29 12:01:26 [auto1.nl] INFO: Saving data for ZT51900: {'auction_closing_time': 1774882852.0, 'created_time': 1774699269.170171, 'last_price_update_time': 1774785686.213913}
2026-03-29 12:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='ZT51900') HTTP/1.1" 204 0
2026-03-29 12:01:26 [auto1.nl] INFO: Found listing with ID: GN27243
2026-03-29 12:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GN27243%27 HTTP/1.1" 200 None
2026-03-29 12:01:26 [auto1.nl] INFO: Scrape type for GN27243: 0
2026-03-29 12:01:26 [auto1.nl] INFO: Found listing with ID: NU66962
2026-03-29 12:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NU66962%27 HTTP/1.1" 200 None
2026-03-29 12:01:26 [auto1.nl] INFO: Scrape type for NU66962: 2
2026-03-29 12:01:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f6803cc5-9c85-5100-a40c-c7330b413d80 with identifier: NU66962
2026-03-29 12:01:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f6803cc5-9c85-5100-a40c-c7330b413d80 with scrape type 2
2026-03-29 12:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f6803cc5-9c85-5100-a40c-c7330b413d80 with scrape type 2
2026-03-29 12:01:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: f6803cc5-9c85-5100-a40c-c7330b413d80, identifier: NU66962
2026-03-29 12:01:26 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 12:01:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: f6803cc5-9c85-5100-a40c-c7330b413d80 with identifier: NU66962
2026-03-29 12:01:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: f6803cc5-9c85-5100-a40c-c7330b413d80 with identifier: NU66962
2026-03-29 12:01:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: f6803cc5-9c85-5100-a40c-c7330b413d80 with identifier: NU66962 to the API
2026-03-29 12:01:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 12:01:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 12:01:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 175,
 'expiration_date': '2026-03-30T15:02:18Z',
 'fuel_type': 'petrol',
 'id': 'f6803cc5-9c85-5100-a40c-c7330b413d80',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NU66962',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'RAV 4',
 'odometer': 159586,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-05-21',
 'seller_name': None,
 'title': 'Toyota RAV 4 2.0 4x2 Active',
 'transmission': 'manual',
 'trim': '4x2 Active',
 'year': 2020}
2026-03-29 12:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NU66962%27 HTTP/1.1" 200 None
2026-03-29 12:01:26 [auto1.nl] INFO: Saving data for NU66962: {'auction_closing_time': 1774882938.0, 'created_time': 1774699247.348726, 'last_price_update_time': 1774785686.77236}
2026-03-29 12:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='NU66962') HTTP/1.1" 204 0
2026-03-29 12:01:26 [auto1.nl] INFO: Found listing with ID: VY08351
2026-03-29 12:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VY08351%27 HTTP/1.1" 200 None
2026-03-29 12:01:26 [auto1.nl] INFO: Scrape type for VY08351: 0
2026-03-29 12:01:26 [auto1.nl] INFO: Found listing with ID: XR71865
2026-03-29 12:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XR71865%27 HTTP/1.1" 200 None
2026-03-29 12:01:26 [auto1.nl] INFO: Scrape type for XR71865: 2
2026-03-29 12:01:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e8c2eb86-b403-52aa-a592-971506686848 with identifier: XR71865
2026-03-29 12:01:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e8c2eb86-b403-52aa-a592-971506686848 with scrape type 2
2026-03-29 12:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e8c2eb86-b403-52aa-a592-971506686848 with scrape type 2
2026-03-29 12:01:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: e8c2eb86-b403-52aa-a592-971506686848, identifier: XR71865
2026-03-29 12:01:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: e8c2eb86-b403-52aa-a592-971506686848 with identifier: XR71865
2026-03-29 12:01:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: e8c2eb86-b403-52aa-a592-971506686848 with identifier: XR71865
2026-03-29 12:01:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: e8c2eb86-b403-52aa-a592-971506686848 with identifier: XR71865 to the API
2026-03-29 12:01:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 12:01:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 12:01:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 136,
 'expiration_date': '2026-03-30T15:27:41Z',
 'fuel_type': 'electro',
 'id': 'e8c2eb86-b403-52aa-a592-971506686848',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XR71865',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Corsa',
 'odometer': 85102,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-10-27',
 'seller_name': None,
 'title': 'Opel Corsa electric drive 100 kW Elegance',
 'transmission': 'automatic',
 'trim': 'Elegance',
 'year': 2020}
2026-03-29 12:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XR71865%27 HTTP/1.1" 200 None
2026-03-29 12:01:27 [auto1.nl] INFO: Saving data for XR71865: {'auction_closing_time': 1774884461.0, 'created_time': 1774699245.717151, 'last_price_update_time': 1774785687.193633}
2026-03-29 12:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='XR71865') HTTP/1.1" 204 0
2026-03-29 12:01:27 [auto1.nl] INFO: Found listing with ID: JM32164
2026-03-29 12:01:27 [auto1.nl] INFO: Found listing with ID: HM06318
2026-03-29 12:01:27 [auto1.nl] INFO: Found listing with ID: KH60865
2026-03-29 12:01:27 [auto1.nl] INFO: Found listing with ID: GS42620
2026-03-29 12:01:27 [auto1.nl] INFO: Found listing with ID: YJ91466
2026-03-29 12:01:27 [auto1.nl] INFO: Channel: 24h | Page: 18 | totalHits: 759 | hits on page: 40
2026-03-29 12:01:27 [auto1.nl] INFO: Found listing with ID: YA06880
2026-03-29 12:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YA06880%27 HTTP/1.1" 200 None
2026-03-29 12:01:27 [auto1.nl] INFO: Scrape type for YA06880: 2
2026-03-29 12:01:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cd4db4de-0d3b-545b-a982-fe02e5dc0961 with identifier: YA06880
2026-03-29 12:01:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cd4db4de-0d3b-545b-a982-fe02e5dc0961 with scrape type 2
2026-03-29 12:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cd4db4de-0d3b-545b-a982-fe02e5dc0961 with scrape type 2
2026-03-29 12:01:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: cd4db4de-0d3b-545b-a982-fe02e5dc0961, identifier: YA06880
2026-03-29 12:01:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 12:01:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: cd4db4de-0d3b-545b-a982-fe02e5dc0961 with identifier: YA06880
2026-03-29 12:01:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: cd4db4de-0d3b-545b-a982-fe02e5dc0961 with identifier: YA06880
2026-03-29 12:01:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: cd4db4de-0d3b-545b-a982-fe02e5dc0961 with identifier: YA06880 to the API
2026-03-29 12:01:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 12:01:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 12:01:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 143,
 'expiration_date': '2026-03-30T15:44:40Z',
 'fuel_type': 'diesel',
 'id': 'cd4db4de-0d3b-545b-a982-fe02e5dc0961',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YA06880',
 'listing': 'auction',
 'make': 'BMW',
 'model': '1er',
 'odometer': 377969,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-01-08',
 'seller_name': None,
 'title': 'BMW 1er 118d',
 'transmission': 'manual',
 'trim': '',
 'year': 2009}
2026-03-29 12:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YA06880%27 HTTP/1.1" 200 None
2026-03-29 12:01:27 [auto1.nl] INFO: Saving data for YA06880: {'auction_closing_time': 1774885480.0, 'created_time': 1774699242.645578, 'last_price_update_time': 1774785687.591822}
2026-03-29 12:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='YA06880') HTTP/1.1" 204 0
2026-03-29 12:01:27 [auto1.nl] INFO: Found listing with ID: PA65227
2026-03-29 12:01:27 [auto1.nl] INFO: Found listing with ID: SE60245
2026-03-29 12:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SE60245%27 HTTP/1.1" 200 None
2026-03-29 12:01:27 [auto1.nl] INFO: Scrape type for SE60245: 2
2026-03-29 12:01:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 414e65a8-2fea-5288-b188-ea04bd4434a8 with identifier: SE60245
2026-03-29 12:01:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 414e65a8-2fea-5288-b188-ea04bd4434a8 with scrape type 2
2026-03-29 12:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 414e65a8-2fea-5288-b188-ea04bd4434a8 with scrape type 2
2026-03-29 12:01:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 414e65a8-2fea-5288-b188-ea04bd4434a8, identifier: SE60245
2026-03-29 12:01:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 414e65a8-2fea-5288-b188-ea04bd4434a8 with identifier: SE60245
2026-03-29 12:01:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 414e65a8-2fea-5288-b188-ea04bd4434a8 with identifier: SE60245
2026-03-29 12:01:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 414e65a8-2fea-5288-b188-ea04bd4434a8 with identifier: SE60245 to the API
2026-03-29 12:01:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 12:01:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 12:01:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 204,
 'expiration_date': '2026-03-30T15:31:06Z',
 'fuel_type': 'electro',
 'id': '414e65a8-2fea-5288-b188-ea04bd4434a8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SE60245',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'ID.3',
 'odometer': 171944,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-09-13',
 'seller_name': None,
 'title': 'Volkswagen ID.3 electric drive 150 kW Life Pro Performance',
 'transmission': 'automatic',
 'trim': 'Life Pro Performance',
 'year': 2021}
2026-03-29 12:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SE60245%27 HTTP/1.1" 200 None
2026-03-29 12:01:27 [auto1.nl] INFO: Saving data for SE60245: {'auction_closing_time': 1774884666.0, 'created_time': 1774699261.351577, 'last_price_update_time': 1774785687.993727}
2026-03-29 12:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='SE60245') HTTP/1.1" 204 0
2026-03-29 12:01:28 [auto1.nl] INFO: Found listing with ID: KL38892
2026-03-29 12:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KL38892%27 HTTP/1.1" 200 None
2026-03-29 12:01:28 [auto1.nl] INFO: Scrape type for KL38892: 2
2026-03-29 12:01:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c62f588c-3746-59a5-a305-46f68cb734f2 with identifier: KL38892
2026-03-29 12:01:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c62f588c-3746-59a5-a305-46f68cb734f2 with scrape type 2
2026-03-29 12:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c62f588c-3746-59a5-a305-46f68cb734f2 with scrape type 2
2026-03-29 12:01:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: c62f588c-3746-59a5-a305-46f68cb734f2, identifier: KL38892
2026-03-29 12:01:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: c62f588c-3746-59a5-a305-46f68cb734f2 with identifier: KL38892
2026-03-29 12:01:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: c62f588c-3746-59a5-a305-46f68cb734f2 with identifier: KL38892
2026-03-29 12:01:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: c62f588c-3746-59a5-a305-46f68cb734f2 with identifier: KL38892 to the API
2026-03-29 12:01:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 12:01:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 12:01:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 204,
 'expiration_date': '2026-03-30T15:00:26Z',
 'fuel_type': 'electro',
 'id': 'c62f588c-3746-59a5-a305-46f68cb734f2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KL38892',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Enyaq',
 'odometer': 169017,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-05-11',
 'seller_name': None,
 'title': 'Skoda Enyaq iV 80 Loft',
 'transmission': 'automatic',
 'trim': 'Loft',
 'year': 2022}
2026-03-29 12:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KL38892%27 HTTP/1.1" 200 None
2026-03-29 12:01:28 [auto1.nl] INFO: Saving data for KL38892: {'auction_closing_time': 1774882826.0, 'created_time': 1774699248.635205, 'last_price_update_time': 1774785688.488616}
2026-03-29 12:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='KL38892') HTTP/1.1" 204 0
2026-03-29 12:01:28 [auto1.nl] INFO: Found listing with ID: HG71940
2026-03-29 12:01:28 [auto1.nl] INFO: Found listing with ID: TW61693
2026-03-29 12:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TW61693%27 HTTP/1.1" 200 None
2026-03-29 12:01:28 [auto1.nl] INFO: Scrape type for TW61693: 2
2026-03-29 12:01:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 05571255-8b87-538b-af8f-7daefb19c9bf with identifier: TW61693
2026-03-29 12:01:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 05571255-8b87-538b-af8f-7daefb19c9bf with scrape type 2
2026-03-29 12:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 05571255-8b87-538b-af8f-7daefb19c9bf with scrape type 2
2026-03-29 12:01:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 05571255-8b87-538b-af8f-7daefb19c9bf, identifier: TW61693
2026-03-29 12:01:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 05571255-8b87-538b-af8f-7daefb19c9bf with identifier: TW61693
2026-03-29 12:01:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 05571255-8b87-538b-af8f-7daefb19c9bf with identifier: TW61693
2026-03-29 12:01:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 05571255-8b87-538b-af8f-7daefb19c9bf with identifier: TW61693 to the API
2026-03-29 12:01:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 12:01:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 12:01:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 98,
 'expiration_date': '2026-03-30T15:33:56Z',
 'fuel_type': 'petrol',
 'id': '05571255-8b87-538b-af8f-7daefb19c9bf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TW61693',
 'listing': 'auction',
 'make': 'MINI',
 'model': 'MINI',
 'odometer': 174156,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-03-17',
 'seller_name': None,
 'title': 'MINI One Minimalist',
 'transmission': 'manual',
 'trim': 'Minimalist',
 'year': 2011}
2026-03-29 12:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TW61693%27 HTTP/1.1" 200 None
2026-03-29 12:01:28 [auto1.nl] INFO: Saving data for TW61693: {'auction_closing_time': 1774884836.0, 'created_time': 1774699245.220006, 'last_price_update_time': 1774785688.884938}
2026-03-29 12:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='TW61693') HTTP/1.1" 204 0
2026-03-29 12:01:28 [auto1.nl] INFO: Found listing with ID: SE95402
2026-03-29 12:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SE95402%27 HTTP/1.1" 200 None
2026-03-29 12:01:28 [auto1.nl] INFO: Scrape type for SE95402: 2
2026-03-29 12:01:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cd7bff2c-839f-53a3-913a-7e1800065f59 with identifier: SE95402
2026-03-29 12:01:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cd7bff2c-839f-53a3-913a-7e1800065f59 with scrape type 2
2026-03-29 12:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cd7bff2c-839f-53a3-913a-7e1800065f59 with scrape type 2
2026-03-29 12:01:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: cd7bff2c-839f-53a3-913a-7e1800065f59, identifier: SE95402
2026-03-29 12:01:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: cd7bff2c-839f-53a3-913a-7e1800065f59 with identifier: SE95402
2026-03-29 12:01:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: cd7bff2c-839f-53a3-913a-7e1800065f59 with identifier: SE95402
2026-03-29 12:01:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: cd7bff2c-839f-53a3-913a-7e1800065f59 with identifier: SE95402 to the API
2026-03-29 12:01:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 12:01:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 12:01:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 204,
 'expiration_date': '2026-03-30T15:58:22Z',
 'fuel_type': 'electro',
 'id': 'cd7bff2c-839f-53a3-913a-7e1800065f59',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SE95402',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'ID.4',
 'odometer': 151881,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-02-22',
 'seller_name': None,
 'title': 'Volkswagen ID.4 electric drive 150 kW Pro Performance',
 'transmission': 'automatic',
 'trim': 'Pro Performance',
 'year': 2023}
2026-03-29 12:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SE95402%27 HTTP/1.1" 200 None
2026-03-29 12:01:29 [auto1.nl] INFO: Saving data for SE95402: {'auction_closing_time': 1774886302.0, 'created_time': 1774699260.527998, 'last_price_update_time': 1774785689.256968}
2026-03-29 12:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='SE95402') HTTP/1.1" 204 0
2026-03-29 12:01:29 [auto1.nl] INFO: Found listing with ID: MV57262
2026-03-29 12:01:29 [auto1.nl] INFO: Found listing with ID: VS29188
2026-03-29 12:01:29 [auto1.nl] INFO: Found listing with ID: RK78214
2026-03-29 12:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RK78214%27 HTTP/1.1" 200 None
2026-03-29 12:01:29 [auto1.nl] INFO: Scrape type for RK78214: 2
2026-03-29 12:01:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9e64196c-af08-5f22-8753-a45314fe44b5 with identifier: RK78214
2026-03-29 12:01:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9e64196c-af08-5f22-8753-a45314fe44b5 with scrape type 2
2026-03-29 12:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9e64196c-af08-5f22-8753-a45314fe44b5 with scrape type 2
2026-03-29 12:01:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 9e64196c-af08-5f22-8753-a45314fe44b5, identifier: RK78214
2026-03-29 12:01:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 9e64196c-af08-5f22-8753-a45314fe44b5 with identifier: RK78214
2026-03-29 12:01:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 9e64196c-af08-5f22-8753-a45314fe44b5 with identifier: RK78214
2026-03-29 12:01:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 9e64196c-af08-5f22-8753-a45314fe44b5 with identifier: RK78214 to the API
2026-03-29 12:01:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 12:01:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 12:01:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 204,
 'expiration_date': '2026-03-30T15:39:18Z',
 'fuel_type': 'electro',
 'id': '9e64196c-af08-5f22-8753-a45314fe44b5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RK78214',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'ID.3',
 'odometer': 113999,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-10-28',
 'seller_name': None,
 'title': 'Volkswagen ID.3 electric drive 150 kW Life Pro Performance',
 'transmission': 'automatic',
 'trim': 'Life Pro Performance',
 'year': 2021}
2026-03-29 12:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RK78214%27 HTTP/1.1" 200 None
2026-03-29 12:01:29 [auto1.nl] INFO: Saving data for RK78214: {'auction_closing_time': 1774885158.0, 'created_time': 1774699260.958371, 'last_price_update_time': 1774785689.639922}
2026-03-29 12:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='RK78214') HTTP/1.1" 204 0
2026-03-29 12:01:29 [auto1.nl] INFO: Found listing with ID: ZZ45478
2026-03-29 12:01:29 [auto1.nl] INFO: Found listing with ID: EW45242
2026-03-29 12:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EW45242%27 HTTP/1.1" 200 None
2026-03-29 12:01:29 [auto1.nl] INFO: Scrape type for EW45242: 2
2026-03-29 12:01:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c08aa1f0-8b82-5feb-a925-af208e6cf76b with identifier: EW45242
2026-03-29 12:01:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c08aa1f0-8b82-5feb-a925-af208e6cf76b with scrape type 2
2026-03-29 12:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c08aa1f0-8b82-5feb-a925-af208e6cf76b with scrape type 2
2026-03-29 12:01:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: c08aa1f0-8b82-5feb-a925-af208e6cf76b, identifier: EW45242
2026-03-29 12:01:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: c08aa1f0-8b82-5feb-a925-af208e6cf76b with identifier: EW45242
2026-03-29 12:01:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: c08aa1f0-8b82-5feb-a925-af208e6cf76b with identifier: EW45242
2026-03-29 12:01:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: c08aa1f0-8b82-5feb-a925-af208e6cf76b with identifier: EW45242 to the API
2026-03-29 12:01:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 12:01:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 12:01:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-30T15:51:16Z',
 'fuel_type': 'petrol',
 'id': 'c08aa1f0-8b82-5feb-a925-af208e6cf76b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EW45242',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Octavia',
 'odometer': 274552,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-03-13',
 'seller_name': None,
 'title': 'Skoda Octavia 1.2 TSI Ambition',
 'transmission': 'automatic',
 'trim': 'Ambition',
 'year': 2013}
2026-03-29 12:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EW45242%27 HTTP/1.1" 200 None
2026-03-29 12:01:30 [auto1.nl] INFO: Saving data for EW45242: {'auction_closing_time': 1774885876.0, 'created_time': 1773774238.383516, 'last_price_update_time': 1774785690.052177}
2026-03-29 12:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='EW45242') HTTP/1.1" 204 0
2026-03-29 12:01:30 [auto1.nl] INFO: Found listing with ID: RW57039
2026-03-29 12:01:30 [auto1.nl] INFO: Found listing with ID: UA80107
2026-03-29 12:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UA80107%27 HTTP/1.1" 200 None
2026-03-29 12:01:30 [auto1.nl] INFO: Scrape type for UA80107: 0
2026-03-29 12:01:30 [auto1.nl] INFO: Found listing with ID: UH76205
2026-03-29 12:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UH76205%27 HTTP/1.1" 200 None
2026-03-29 12:01:30 [auto1.nl] INFO: Scrape type for UH76205: 0
2026-03-29 12:01:30 [auto1.nl] INFO: Found listing with ID: HM15601
2026-03-29 12:01:30 [auto1.nl] INFO: Found listing with ID: KX92525
2026-03-29 12:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KX92525%27 HTTP/1.1" 200 None
2026-03-29 12:01:30 [auto1.nl] INFO: Scrape type for KX92525: 0
2026-03-29 12:01:30 [auto1.nl] INFO: Found listing with ID: UU92994
2026-03-29 12:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UU92994%27 HTTP/1.1" 200 None
2026-03-29 12:01:30 [auto1.nl] INFO: Scrape type for UU92994: 0
2026-03-29 12:01:30 [auto1.nl] INFO: Found listing with ID: WY17438
2026-03-29 12:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WY17438%27 HTTP/1.1" 200 None
2026-03-29 12:01:30 [auto1.nl] INFO: Scrape type for WY17438: 0
2026-03-29 12:01:30 [auto1.nl] INFO: Found listing with ID: GP36316
2026-03-29 12:01:30 [auto1.nl] INFO: Found listing with ID: ZS54708
2026-03-29 12:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZS54708%27 HTTP/1.1" 200 None
2026-03-29 12:01:30 [auto1.nl] INFO: Scrape type for ZS54708: 0
2026-03-29 12:01:30 [auto1.nl] INFO: Found listing with ID: UE83954
2026-03-29 12:01:30 [auto1.nl] INFO: Found listing with ID: BB32456
2026-03-29 12:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BB32456%27 HTTP/1.1" 200 None
2026-03-29 12:01:30 [auto1.nl] INFO: Scrape type for BB32456: 0
2026-03-29 12:01:30 [auto1.nl] INFO: Found listing with ID: XG85677
2026-03-29 12:01:30 [auto1.nl] INFO: Found listing with ID: WW25859
2026-03-29 12:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WW25859%27 HTTP/1.1" 200 None
2026-03-29 12:01:30 [auto1.nl] INFO: Scrape type for WW25859: 0
2026-03-29 12:01:30 [auto1.nl] INFO: Found listing with ID: SX97177
2026-03-29 12:01:30 [auto1.nl] INFO: Found listing with ID: BP52845
2026-03-29 12:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BP52845%27 HTTP/1.1" 200 None
2026-03-29 12:01:30 [auto1.nl] INFO: Scrape type for BP52845: 2
2026-03-29 12:01:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 83fb62fd-c291-5280-8113-1b0eaf1e77f4 with identifier: BP52845
2026-03-29 12:01:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 83fb62fd-c291-5280-8113-1b0eaf1e77f4 with scrape type 2
2026-03-29 12:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 83fb62fd-c291-5280-8113-1b0eaf1e77f4 with scrape type 2
2026-03-29 12:01:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 83fb62fd-c291-5280-8113-1b0eaf1e77f4, identifier: BP52845
2026-03-29 12:01:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 83fb62fd-c291-5280-8113-1b0eaf1e77f4 with identifier: BP52845
2026-03-29 12:01:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 83fb62fd-c291-5280-8113-1b0eaf1e77f4 with identifier: BP52845
2026-03-29 12:01:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 83fb62fd-c291-5280-8113-1b0eaf1e77f4 with identifier: BP52845 to the API
2026-03-29 12:01:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 12:01:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 12:01:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 441,
 'expiration_date': '2026-03-30T15:53:11Z',
 'fuel_type': 'electro',
 'id': '83fb62fd-c291-5280-8113-1b0eaf1e77f4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BP52845',
 'listing': 'auction',
 'make': 'Tesla',
 'model': 'Model 3',
 'odometer': 184012,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-06-06',
 'seller_name': None,
 'title': 'Tesla Model 3 Long Range Dual AWD AWD',
 'transmission': 'automatic',
 'trim': 'AWD',
 'year': 2019}
2026-03-29 12:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BP52845%27 HTTP/1.1" 200 None
2026-03-29 12:01:30 [auto1.nl] INFO: Saving data for BP52845: {'auction_closing_time': 1774885991.0, 'created_time': 1774699287.566571, 'last_price_update_time': 1774785690.605791}
2026-03-29 12:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='BP52845') HTTP/1.1" 204 0
2026-03-29 12:01:30 [auto1.nl] INFO: Found listing with ID: DX51815
2026-03-29 12:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DX51815%27 HTTP/1.1" 200 None
2026-03-29 12:01:30 [auto1.nl] INFO: Scrape type for DX51815: 2
2026-03-29 12:01:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 99394b93-3aa2-5ad8-b39d-267937e48230 with identifier: DX51815
2026-03-29 12:01:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 99394b93-3aa2-5ad8-b39d-267937e48230 with scrape type 2
2026-03-29 12:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 99394b93-3aa2-5ad8-b39d-267937e48230 with scrape type 2
2026-03-29 12:01:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 99394b93-3aa2-5ad8-b39d-267937e48230, identifier: DX51815
2026-03-29 12:01:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 99394b93-3aa2-5ad8-b39d-267937e48230 with identifier: DX51815
2026-03-29 12:01:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 99394b93-3aa2-5ad8-b39d-267937e48230 with identifier: DX51815
2026-03-29 12:01:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 99394b93-3aa2-5ad8-b39d-267937e48230 with identifier: DX51815 to the API
2026-03-29 12:01:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 12:01:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 12:01:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-30T15:37:13Z',
 'fuel_type': 'petrol',
 'id': '99394b93-3aa2-5ad8-b39d-267937e48230',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DX51815',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VIII',
 'odometer': 235171,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-03-29',
 'seller_name': None,
 'title': 'Volkswagen Golf VIII 1.5 eTSI ACT Style',
 'transmission': 'automatic',
 'trim': 'Style',
 'year': 2020}
2026-03-29 12:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DX51815%27 HTTP/1.1" 200 None
2026-03-29 12:01:31 [auto1.nl] INFO: Saving data for DX51815: {'auction_closing_time': 1774885033.0, 'created_time': 1774699277.984793, 'last_price_update_time': 1774785691.400269}
2026-03-29 12:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='DX51815') HTTP/1.1" 204 0
2026-03-29 12:01:31 [auto1.nl] INFO: Found listing with ID: PF57895
2026-03-29 12:01:31 [auto1.nl] INFO: Found listing with ID: HV92208
2026-03-29 12:01:31 [auto1.nl] INFO: Found listing with ID: WY33906
2026-03-29 12:01:31 [auto1.nl] INFO: Found listing with ID: WN49119
2026-03-29 12:01:31 [auto1.nl] INFO: Found listing with ID: NJ12224
2026-03-29 12:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NJ12224%27 HTTP/1.1" 200 None
2026-03-29 12:01:31 [auto1.nl] INFO: Scrape type for NJ12224: 2
2026-03-29 12:01:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6225da9c-cd5e-52d7-89f4-e343143e4f34 with identifier: NJ12224
2026-03-29 12:01:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6225da9c-cd5e-52d7-89f4-e343143e4f34 with scrape type 2
2026-03-29 12:01:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6225da9c-cd5e-52d7-89f4-e343143e4f34 with scrape type 2
2026-03-29 12:01:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 6225da9c-cd5e-52d7-89f4-e343143e4f34, identifier: NJ12224
2026-03-29 12:01:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 6225da9c-cd5e-52d7-89f4-e343143e4f34 with identifier: NJ12224
2026-03-29 12:01:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 6225da9c-cd5e-52d7-89f4-e343143e4f34 with identifier: NJ12224
2026-03-29 12:01:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 6225da9c-cd5e-52d7-89f4-e343143e4f34 with identifier: NJ12224 to the API
2026-03-29 12:01:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 12:01:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 12:01:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-30T15:34:47Z',
 'fuel_type': 'diesel',
 'id': '6225da9c-cd5e-52d7-89f4-e343143e4f34',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NJ12224',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Trafic',
 'odometer': 402077,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-06-29',
 'seller_name': None,
 'title': 'Renault Trafic 2.0 dCi Passenger Expression',
 'transmission': 'manual',
 'trim': 'Passenger Expression',
 'year': 2008}
2026-03-29 12:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NJ12224%27 HTTP/1.1" 200 None
2026-03-29 12:01:31 [auto1.nl] INFO: Saving data for NJ12224: {'auction_closing_time': 1774884887.0, 'created_time': 1774699281.644293, 'last_price_update_time': 1774785691.810579}
2026-03-29 12:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='NJ12224') HTTP/1.1" 204 0
2026-03-29 12:01:31 [auto1.nl] INFO: Found listing with ID: XM87869
2026-03-29 12:01:31 [auto1.nl] INFO: Found listing with ID: DJ46393
2026-03-29 12:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DJ46393%27 HTTP/1.1" 200 None
2026-03-29 12:01:31 [auto1.nl] INFO: Scrape type for DJ46393: 2
2026-03-29 12:01:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 51840e3b-06c3-5d43-a9f2-5efdc8c8c345 with identifier: DJ46393
2026-03-29 12:01:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 51840e3b-06c3-5d43-a9f2-5efdc8c8c345 with scrape type 2
2026-03-29 12:01:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 51840e3b-06c3-5d43-a9f2-5efdc8c8c345 with scrape type 2
2026-03-29 12:01:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 51840e3b-06c3-5d43-a9f2-5efdc8c8c345, identifier: DJ46393
2026-03-29 12:01:31 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 12:01:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 51840e3b-06c3-5d43-a9f2-5efdc8c8c345 with identifier: DJ46393
2026-03-29 12:01:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 51840e3b-06c3-5d43-a9f2-5efdc8c8c345 with identifier: DJ46393
2026-03-29 12:01:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 51840e3b-06c3-5d43-a9f2-5efdc8c8c345 with identifier: DJ46393 to the API
2026-03-29 12:01:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 12:01:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 12:01:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 67,
 'expiration_date': '2026-03-30T15:28:42Z',
 'fuel_type': 'petrol',
 'id': '51840e3b-06c3-5d43-a9f2-5efdc8c8c345',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DJ46393',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'i10',
 'odometer': 102422,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-04-03',
 'seller_name': None,
 'title': 'Hyundai i10 1.0 Comfort',
 'transmission': 'manual',
 'trim': 'Comfort',
 'year': 2016}
2026-03-29 12:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DJ46393%27 HTTP/1.1" 200 None
2026-03-29 12:01:32 [auto1.nl] INFO: Saving data for DJ46393: {'auction_closing_time': 1774884522.0, 'created_time': 1774699286.145627, 'last_price_update_time': 1774785692.242488}
2026-03-29 12:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='DJ46393') HTTP/1.1" 204 0
2026-03-29 12:01:32 [auto1.nl] INFO: Found listing with ID: FB82909
2026-03-29 12:01:32 [auto1.nl] INFO: Found listing with ID: JF84007
2026-03-29 12:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JF84007%27 HTTP/1.1" 200 None
2026-03-29 12:01:32 [auto1.nl] INFO: Scrape type for JF84007: 2
2026-03-29 12:01:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 99a0e11b-1e01-5d26-84aa-8887a06e5405 with identifier: JF84007
2026-03-29 12:01:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 99a0e11b-1e01-5d26-84aa-8887a06e5405 with scrape type 2
2026-03-29 12:01:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 99a0e11b-1e01-5d26-84aa-8887a06e5405 with scrape type 2
2026-03-29 12:01:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 99a0e11b-1e01-5d26-84aa-8887a06e5405, identifier: JF84007
2026-03-29 12:01:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 99a0e11b-1e01-5d26-84aa-8887a06e5405 with identifier: JF84007
2026-03-29 12:01:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 99a0e11b-1e01-5d26-84aa-8887a06e5405 with identifier: JF84007
2026-03-29 12:01:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 99a0e11b-1e01-5d26-84aa-8887a06e5405 with identifier: JF84007 to the API
2026-03-29 12:01:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 12:01:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 12:01:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 85,
 'expiration_date': '2026-03-30T15:05:14Z',
 'fuel_type': 'petrol',
 'id': '99a0e11b-1e01-5d26-84aa-8887a06e5405',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JF84007',
 'listing': 'auction',
 'make': 'Fiat',
 'model': '500',
 'odometer': 75581,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-12-28',
 'seller_name': None,
 'title': 'Fiat 500 0.9 Pop',
 'transmission': 'automatic',
 'trim': 'Pop',
 'year': 2015}
2026-03-29 12:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JF84007%27 HTTP/1.1" 200 None
2026-03-29 12:01:32 [auto1.nl] INFO: Saving data for JF84007: {'auction_closing_time': 1774883114.0, 'created_time': 1774699283.644347, 'last_price_update_time': 1774785692.704577}
2026-03-29 12:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='JF84007') HTTP/1.1" 204 0
2026-03-29 12:01:32 [auto1.nl] INFO: Found listing with ID: KD48941
2026-03-29 12:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KD48941%27 HTTP/1.1" 200 None
2026-03-29 12:01:32 [auto1.nl] INFO: Scrape type for KD48941: 2
2026-03-29 12:01:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 444b097d-a620-589d-bc25-11cf1320e560 with identifier: KD48941
2026-03-29 12:01:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 444b097d-a620-589d-bc25-11cf1320e560 with scrape type 2
2026-03-29 12:01:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 444b097d-a620-589d-bc25-11cf1320e560 with scrape type 2
2026-03-29 12:01:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 444b097d-a620-589d-bc25-11cf1320e560, identifier: KD48941
2026-03-29 12:01:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 444b097d-a620-589d-bc25-11cf1320e560 with identifier: KD48941
2026-03-29 12:01:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 444b097d-a620-589d-bc25-11cf1320e560 with identifier: KD48941
2026-03-29 12:01:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 444b097d-a620-589d-bc25-11cf1320e560 with identifier: KD48941 to the API
2026-03-29 12:01:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 12:01:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 12:01:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 68,
 'expiration_date': '2026-03-30T15:31:18Z',
 'fuel_type': 'petrol',
 'id': '444b097d-a620-589d-bc25-11cf1320e560',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KD48941',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'Aygo',
 'odometer': 71806,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-04-03',
 'seller_name': None,
 'title': 'Toyota Aygo 1.0 City',
 'transmission': 'manual',
 'trim': 'City',
 'year': 2011}
2026-03-29 12:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KD48941%27 HTTP/1.1" 200 None
2026-03-29 12:01:33 [auto1.nl] INFO: Saving data for KD48941: {'auction_closing_time': 1774884678.0, 'created_time': 1774699277.292958, 'last_price_update_time': 1774785693.124637}
2026-03-29 12:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='KD48941') HTTP/1.1" 204 0
2026-03-29 12:01:33 [auto1.nl] INFO: Channel: 24h | Page: 19 | totalHits: 759 | hits on page: 39
2026-03-29 12:01:33 [auto1.nl] INFO: Found listing with ID: WN94746
2026-03-29 12:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WN94746%27 HTTP/1.1" 200 None
2026-03-29 12:01:33 [auto1.nl] INFO: Scrape type for WN94746: 2
2026-03-29 12:01:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2ac72c08-1d0a-5646-915f-155391cbd170 with identifier: WN94746
2026-03-29 12:01:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2ac72c08-1d0a-5646-915f-155391cbd170 with scrape type 2
2026-03-29 12:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2ac72c08-1d0a-5646-915f-155391cbd170 with scrape type 2
2026-03-29 12:01:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 2ac72c08-1d0a-5646-915f-155391cbd170, identifier: WN94746
2026-03-29 12:01:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 2ac72c08-1d0a-5646-915f-155391cbd170 with identifier: WN94746
2026-03-29 12:01:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 2ac72c08-1d0a-5646-915f-155391cbd170 with identifier: WN94746
2026-03-29 12:01:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 2ac72c08-1d0a-5646-915f-155391cbd170 with identifier: WN94746 to the API
2026-03-29 12:01:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 12:01:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 12:01:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-30T15:21:47Z',
 'fuel_type': 'petrol',
 'id': '2ac72c08-1d0a-5646-915f-155391cbd170',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WN94746',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf Plus',
 'odometer': 253618,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-05-05',
 'seller_name': None,
 'title': 'Volkswagen Golf Plus 1.4 TSI Trendline',
 'transmission': 'manual',
 'trim': 'Trendline',
 'year': 2008}
2026-03-29 12:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WN94746%27 HTTP/1.1" 200 None
2026-03-29 12:01:33 [auto1.nl] INFO: Saving data for WN94746: {'auction_closing_time': 1774884107.0, 'created_time': 1774699283.004934, 'last_price_update_time': 1774785693.657614}
2026-03-29 12:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='WN94746') HTTP/1.1" 204 0
2026-03-29 12:01:33 [auto1.nl] INFO: Found listing with ID: WU56616
2026-03-29 12:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WU56616%27 HTTP/1.1" 200 None
2026-03-29 12:01:33 [auto1.nl] INFO: Scrape type for WU56616: 2
2026-03-29 12:01:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4cb1d3e2-493a-5b66-a1fc-7cd87ef18bfb with identifier: WU56616
2026-03-29 12:01:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4cb1d3e2-493a-5b66-a1fc-7cd87ef18bfb with scrape type 2
2026-03-29 12:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4cb1d3e2-493a-5b66-a1fc-7cd87ef18bfb with scrape type 2
2026-03-29 12:01:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 4cb1d3e2-493a-5b66-a1fc-7cd87ef18bfb, identifier: WU56616
2026-03-29 12:01:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-29 12:01:33 [auto1.nl] INFO: Found listing with ID: EU38085
2026-03-29 12:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EU38085%27 HTTP/1.1" 200 None
2026-03-29 12:01:33 [auto1.nl] INFO: Scrape type for EU38085: 2
2026-03-29 12:01:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4f2cef4e-0091-545e-a089-052ef2312c17 with identifier: EU38085
2026-03-29 12:01:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4f2cef4e-0091-545e-a089-052ef2312c17 with scrape type 2
2026-03-29 12:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4f2cef4e-0091-545e-a089-052ef2312c17 with scrape type 2
2026-03-29 12:01:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 4f2cef4e-0091-545e-a089-052ef2312c17, identifier: EU38085
2026-03-29 12:01:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 4cb1d3e2-493a-5b66-a1fc-7cd87ef18bfb with identifier: WU56616
2026-03-29 12:01:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 4cb1d3e2-493a-5b66-a1fc-7cd87ef18bfb with identifier: WU56616
2026-03-29 12:01:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 4cb1d3e2-493a-5b66-a1fc-7cd87ef18bfb with identifier: WU56616 to the API
2026-03-29 12:01:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 12:01:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 12:01:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-30T15:05:28Z',
 'fuel_type': 'petrol',
 'id': '4cb1d3e2-493a-5b66-a1fc-7cd87ef18bfb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WU56616',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 183729,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-05-09',
 'seller_name': None,
 'title': 'Ford Focus 1.6 Trend',
 'transmission': 'manual',
 'trim': 'Trend',
 'year': 2007}
2026-03-29 12:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WU56616%27 HTTP/1.1" 200 None
2026-03-29 12:01:34 [auto1.nl] INFO: Saving data for WU56616: {'auction_closing_time': 1774883128.0, 'created_time': 1774699248.980939, 'last_price_update_time': 1774785694.190413}
2026-03-29 12:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='WU56616') HTTP/1.1" 204 0
2026-03-29 12:01:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 4f2cef4e-0091-545e-a089-052ef2312c17 with identifier: EU38085
2026-03-29 12:01:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 4f2cef4e-0091-545e-a089-052ef2312c17 with identifier: EU38085
2026-03-29 12:01:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 4f2cef4e-0091-545e-a089-052ef2312c17 with identifier: EU38085 to the API
2026-03-29 12:01:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 12:01:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 12:01:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-30T15:50:57Z',
 'fuel_type': 'diesel',
 'id': '4f2cef4e-0091-545e-a089-052ef2312c17',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EU38085',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'M-Klasse',
 'odometer': 272322,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-09-18',
 'seller_name': None,
 'title': 'Mercedes-Benz M-Klasse ML 280 CDI',
 'transmission': 'automatic',
 'trim': '',
 'year': 2008}
2026-03-29 12:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EU38085%27 HTTP/1.1" 200 None
2026-03-29 12:01:34 [auto1.nl] INFO: Saving data for EU38085: {'auction_closing_time': 1774885857.0, 'created_time': 1774699282.377658, 'last_price_update_time': 1774785694.491977}
2026-03-29 12:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='EU38085') HTTP/1.1" 204 0
2026-03-29 12:01:34 [auto1.nl] INFO: Found listing with ID: YX65431
2026-03-29 12:01:34 [auto1.nl] INFO: Found listing with ID: CT48510
2026-03-29 12:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CT48510%27 HTTP/1.1" 200 None
2026-03-29 12:01:34 [auto1.nl] INFO: Scrape type for CT48510: 2
2026-03-29 12:01:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 92f46fc1-87e1-5d13-bdf2-6214e122592d with identifier: CT48510
2026-03-29 12:01:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 92f46fc1-87e1-5d13-bdf2-6214e122592d with scrape type 2
2026-03-29 12:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 92f46fc1-87e1-5d13-bdf2-6214e122592d with scrape type 2
2026-03-29 12:01:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 92f46fc1-87e1-5d13-bdf2-6214e122592d, identifier: CT48510
2026-03-29 12:01:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 92f46fc1-87e1-5d13-bdf2-6214e122592d with identifier: CT48510
2026-03-29 12:01:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 92f46fc1-87e1-5d13-bdf2-6214e122592d with identifier: CT48510
2026-03-29 12:01:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 92f46fc1-87e1-5d13-bdf2-6214e122592d with identifier: CT48510 to the API
2026-03-29 12:01:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 12:01:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 12:01:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-30T15:32:48Z',
 'fuel_type': 'petrol',
 'id': '92f46fc1-87e1-5d13-bdf2-6214e122592d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CT48510',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Ka',
 'odometer': 119784,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-02-17',
 'seller_name': None,
 'title': 'Ford Ka 1.2 Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2010}
2026-03-29 12:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CT48510%27 HTTP/1.1" 200 None
2026-03-29 12:01:34 [auto1.nl] INFO: Saving data for CT48510: {'auction_closing_time': 1774884768.0, 'created_time': 1774699263.004623, 'last_price_update_time': 1774785694.89116}
2026-03-29 12:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='CT48510') HTTP/1.1" 204 0
2026-03-29 12:01:34 [auto1.nl] INFO: Found listing with ID: MZ74119
2026-03-29 12:01:34 [auto1.nl] INFO: Found listing with ID: RD76922
2026-03-29 12:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RD76922%27 HTTP/1.1" 200 None
2026-03-29 12:01:34 [auto1.nl] INFO: Scrape type for RD76922: 2
2026-03-29 12:01:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b187d90e-f2a0-5fe8-9a3d-550b69fae3ba with identifier: RD76922
2026-03-29 12:01:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b187d90e-f2a0-5fe8-9a3d-550b69fae3ba with scrape type 2
2026-03-29 12:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b187d90e-f2a0-5fe8-9a3d-550b69fae3ba with scrape type 2
2026-03-29 12:01:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: b187d90e-f2a0-5fe8-9a3d-550b69fae3ba, identifier: RD76922
2026-03-29 12:01:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: b187d90e-f2a0-5fe8-9a3d-550b69fae3ba with identifier: RD76922
2026-03-29 12:01:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: b187d90e-f2a0-5fe8-9a3d-550b69fae3ba with identifier: RD76922
2026-03-29 12:01:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: b187d90e-f2a0-5fe8-9a3d-550b69fae3ba with identifier: RD76922 to the API
2026-03-29 12:01:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 12:01:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 12:01:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 82,
 'expiration_date': '2026-03-30T15:09:22Z',
 'fuel_type': 'petrol',
 'id': 'b187d90e-f2a0-5fe8-9a3d-550b69fae3ba',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RD76922',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C4 Cactus',
 'odometer': 206564,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-03-31',
 'seller_name': None,
 'title': 'Citroen C4 Cactus 1.2 VTi Shine',
 'transmission': 'manual',
 'trim': 'Shine',
 'year': 2017}
2026-03-29 12:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RD76922%27 HTTP/1.1" 200 None
2026-03-29 12:01:35 [auto1.nl] INFO: Saving data for RD76922: {'auction_closing_time': 1774883362.0, 'created_time': 1774699263.393796, 'last_price_update_time': 1774785695.285899}
2026-03-29 12:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='RD76922') HTTP/1.1" 204 0
2026-03-29 12:01:35 [auto1.nl] INFO: Found listing with ID: GW58352
2026-03-29 12:01:35 [auto1.nl] INFO: Found listing with ID: JB09830
2026-03-29 12:01:35 [auto1.nl] INFO: Found listing with ID: CY78777
2026-03-29 12:01:35 [auto1.nl] INFO: Found listing with ID: WC26387
2026-03-29 12:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WC26387%27 HTTP/1.1" 200 None
2026-03-29 12:01:35 [auto1.nl] INFO: Scrape type for WC26387: 2
2026-03-29 12:01:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8a02d6d4-f622-5010-9d10-9b4d747b9630 with identifier: WC26387
2026-03-29 12:01:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8a02d6d4-f622-5010-9d10-9b4d747b9630 with scrape type 2
2026-03-29 12:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8a02d6d4-f622-5010-9d10-9b4d747b9630 with scrape type 2
2026-03-29 12:01:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 8a02d6d4-f622-5010-9d10-9b4d747b9630, identifier: WC26387
2026-03-29 12:01:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 8a02d6d4-f622-5010-9d10-9b4d747b9630 with identifier: WC26387
2026-03-29 12:01:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 8a02d6d4-f622-5010-9d10-9b4d747b9630 with identifier: WC26387
2026-03-29 12:01:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 8a02d6d4-f622-5010-9d10-9b4d747b9630 with identifier: WC26387 to the API
2026-03-29 12:01:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 12:01:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 12:01:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-30T15:52:53Z',
 'fuel_type': 'diesel',
 'id': '8a02d6d4-f622-5010-9d10-9b4d747b9630',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WC26387',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'Vito',
 'odometer': 271792,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-11-09',
 'seller_name': None,
 'title': 'Mercedes-Benz Vito 113 CDI lang',
 'transmission': 'automatic',
 'trim': 'lang',
 'year': 2010}
2026-03-29 12:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WC26387%27 HTTP/1.1" 200 None
2026-03-29 12:01:35 [auto1.nl] INFO: Saving data for WC26387: {'auction_closing_time': 1774885973.0, 'created_time': 1774008059.084225, 'last_price_update_time': 1774785695.663372}
2026-03-29 12:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='WC26387') HTTP/1.1" 204 0
2026-03-29 12:01:35 [auto1.nl] INFO: Found listing with ID: LF00808
2026-03-29 12:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LF00808%27 HTTP/1.1" 200 None
2026-03-29 12:01:35 [auto1.nl] INFO: Scrape type for LF00808: 2
2026-03-29 12:01:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a64a4567-874e-5e91-8545-53bd59ed3bcf with identifier: LF00808
2026-03-29 12:01:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a64a4567-874e-5e91-8545-53bd59ed3bcf with scrape type 2
2026-03-29 12:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a64a4567-874e-5e91-8545-53bd59ed3bcf with scrape type 2
2026-03-29 12:01:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: a64a4567-874e-5e91-8545-53bd59ed3bcf, identifier: LF00808
2026-03-29 12:01:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: a64a4567-874e-5e91-8545-53bd59ed3bcf with identifier: LF00808
2026-03-29 12:01:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: a64a4567-874e-5e91-8545-53bd59ed3bcf with identifier: LF00808
2026-03-29 12:01:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: a64a4567-874e-5e91-8545-53bd59ed3bcf with identifier: LF00808 to the API
2026-03-29 12:01:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 12:01:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 12:01:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-30T15:03:15Z',
 'fuel_type': 'petrol',
 'id': 'a64a4567-874e-5e91-8545-53bd59ed3bcf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LF00808',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '207',
 'odometer': 173258,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-04-14',
 'seller_name': None,
 'title': 'Peugeot 207 1.6 Sport',
 'transmission': 'automatic',
 'trim': 'Sport',
 'year': 2008}
2026-03-29 12:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LF00808%27 HTTP/1.1" 200 None
2026-03-29 12:01:36 [auto1.nl] INFO: Saving data for LF00808: {'auction_closing_time': 1774882995.0, 'created_time': 1774699254.772537, 'last_price_update_time': 1774785696.151724}
2026-03-29 12:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='LF00808') HTTP/1.1" 204 0
2026-03-29 12:01:36 [auto1.nl] INFO: Found listing with ID: DL13637
2026-03-29 12:01:36 [auto1.nl] INFO: Found listing with ID: CD19489
2026-03-29 12:01:36 [auto1.nl] INFO: Found listing with ID: RY80321
2026-03-29 12:01:36 [auto1.nl] INFO: Found listing with ID: JM92964
2026-03-29 12:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JM92964%27 HTTP/1.1" 200 None
2026-03-29 12:01:36 [auto1.nl] INFO: Scrape type for JM92964: 2
2026-03-29 12:01:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 73bdbdbb-1e7d-50a7-b51e-883cbdba877e with identifier: JM92964
2026-03-29 12:01:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 73bdbdbb-1e7d-50a7-b51e-883cbdba877e with scrape type 2
2026-03-29 12:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 73bdbdbb-1e7d-50a7-b51e-883cbdba877e with scrape type 2
2026-03-29 12:01:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 73bdbdbb-1e7d-50a7-b51e-883cbdba877e, identifier: JM92964
2026-03-29 12:01:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 73bdbdbb-1e7d-50a7-b51e-883cbdba877e with identifier: JM92964
2026-03-29 12:01:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 73bdbdbb-1e7d-50a7-b51e-883cbdba877e with identifier: JM92964
2026-03-29 12:01:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 73bdbdbb-1e7d-50a7-b51e-883cbdba877e with identifier: JM92964 to the API
2026-03-29 12:01:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 12:01:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 12:01:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 60,
 'expiration_date': '2026-03-30T15:32:01Z',
 'fuel_type': 'petrol',
 'id': '73bdbdbb-1e7d-50a7-b51e-883cbdba877e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JM92964',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Mii',
 'odometer': 187016,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-01-17',
 'seller_name': None,
 'title': 'Seat Mii 1.0 FR-Line',
 'transmission': 'manual',
 'trim': 'FR-Line',
 'year': 2017}
2026-03-29 12:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JM92964%27 HTTP/1.1" 200 None
2026-03-29 12:01:36 [auto1.nl] INFO: Saving data for JM92964: {'auction_closing_time': 1774884721.0, 'created_time': 1774699258.401759, 'last_price_update_time': 1774785696.552369}
2026-03-29 12:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='JM92964') HTTP/1.1" 204 0
2026-03-29 12:01:36 [auto1.nl] INFO: Found listing with ID: KC04488
2026-03-29 12:01:36 [auto1.nl] INFO: Found listing with ID: SK13348
2026-03-29 12:01:36 [auto1.nl] INFO: Found listing with ID: JB39700
2026-03-29 12:01:36 [auto1.nl] INFO: Found listing with ID: NZ86515
2026-03-29 12:01:36 [auto1.nl] INFO: Found listing with ID: HJ37238
2026-03-29 12:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HJ37238%27 HTTP/1.1" 200 None
2026-03-29 12:01:36 [auto1.nl] INFO: Scrape type for HJ37238: 2
2026-03-29 12:01:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 473c01f0-6dff-59e4-b78f-b7bd6be80c04 with identifier: HJ37238
2026-03-29 12:01:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 473c01f0-6dff-59e4-b78f-b7bd6be80c04 with scrape type 2
2026-03-29 12:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 473c01f0-6dff-59e4-b78f-b7bd6be80c04 with scrape type 2
2026-03-29 12:01:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 473c01f0-6dff-59e4-b78f-b7bd6be80c04, identifier: HJ37238
2026-03-29 12:01:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 473c01f0-6dff-59e4-b78f-b7bd6be80c04 with identifier: HJ37238
2026-03-29 12:01:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 473c01f0-6dff-59e4-b78f-b7bd6be80c04 with identifier: HJ37238
2026-03-29 12:01:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 473c01f0-6dff-59e4-b78f-b7bd6be80c04 with identifier: HJ37238 to the API
2026-03-29 12:01:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 12:01:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 12:01:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-30T15:54:27Z',
 'fuel_type': 'diesel',
 'id': '473c01f0-6dff-59e4-b78f-b7bd6be80c04',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HJ37238',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Kangoo',
 'odometer': 229510,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-06-12',
 'seller_name': None,
 'title': 'Renault Kangoo 1.5 dCi Rapid Compact Basis',
 'transmission': 'manual',
 'trim': 'Rapid Compact Basis',
 'year': 2019}
2026-03-29 12:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HJ37238%27 HTTP/1.1" 200 None
2026-03-29 12:01:36 [auto1.nl] INFO: Saving data for HJ37238: {'auction_closing_time': 1774886067.0, 'created_time': 1774002028.690083, 'last_price_update_time': 1774785696.981229}
2026-03-29 12:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='HJ37238') HTTP/1.1" 204 0
2026-03-29 12:01:37 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-29 12:01:37 [auto1.nl] INFO: Found listing with ID: JK34334
2026-03-29 12:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JK34334%27 HTTP/1.1" 200 None
2026-03-29 12:01:37 [auto1.nl] INFO: Scrape type for JK34334: 2
2026-03-29 12:01:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 413cc031-18a1-59e6-a153-6656c2207504 with identifier: JK34334
2026-03-29 12:01:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 413cc031-18a1-59e6-a153-6656c2207504 with scrape type 2
2026-03-29 12:01:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 413cc031-18a1-59e6-a153-6656c2207504 with scrape type 2
2026-03-29 12:01:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 413cc031-18a1-59e6-a153-6656c2207504, identifier: JK34334
2026-03-29 12:01:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 413cc031-18a1-59e6-a153-6656c2207504 with identifier: JK34334
2026-03-29 12:01:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 413cc031-18a1-59e6-a153-6656c2207504 with identifier: JK34334
2026-03-29 12:01:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 413cc031-18a1-59e6-a153-6656c2207504 with identifier: JK34334 to the API
2026-03-29 12:01:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 12:01:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 12:01:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 205,
 'expiration_date': '2026-03-30T15:23:00Z',
 'fuel_type': 'petrol',
 'id': '413cc031-18a1-59e6-a153-6656c2207504',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JK34334',
 'listing': 'auction',
 'make': 'BMW',
 'model': '5er',
 'odometer': 182947,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-02-24',
 'seller_name': None,
 'title': 'BMW 5er 523i',
 'transmission': 'automatic',
 'trim': '',
 'year': 2011}
2026-03-29 12:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JK34334%27 HTTP/1.1" 200 None
2026-03-29 12:01:37 [auto1.nl] INFO: Saving data for JK34334: {'auction_closing_time': 1774884180.0, 'created_time': 1774699257.77111, 'last_price_update_time': 1774785697.392917}
2026-03-29 12:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='JK34334') HTTP/1.1" 204 0
2026-03-29 12:01:37 [auto1.nl] INFO: Found listing with ID: YB88576
2026-03-29 12:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YB88576%27 HTTP/1.1" 200 None
2026-03-29 12:01:37 [auto1.nl] INFO: Scrape type for YB88576: 2
2026-03-29 12:01:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d2d8fe64-2e0f-5774-af0e-e5b13e499b1e with identifier: YB88576
2026-03-29 12:01:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d2d8fe64-2e0f-5774-af0e-e5b13e499b1e with scrape type 2
2026-03-29 12:01:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d2d8fe64-2e0f-5774-af0e-e5b13e499b1e with scrape type 2
2026-03-29 12:01:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: d2d8fe64-2e0f-5774-af0e-e5b13e499b1e, identifier: YB88576
2026-03-29 12:01:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: d2d8fe64-2e0f-5774-af0e-e5b13e499b1e with identifier: YB88576
2026-03-29 12:01:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: d2d8fe64-2e0f-5774-af0e-e5b13e499b1e with identifier: YB88576
2026-03-29 12:01:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: d2d8fe64-2e0f-5774-af0e-e5b13e499b1e with identifier: YB88576 to the API
2026-03-29 12:01:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 12:01:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 12:01:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 131,
 'expiration_date': '2026-03-30T15:13:27Z',
 'fuel_type': 'diesel',
 'id': 'd2d8fe64-2e0f-5774-af0e-e5b13e499b1e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YB88576',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'Berlingo',
 'odometer': 143378,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-10-24',
 'seller_name': None,
 'title': 'Citroen Berlingo 1.5 Blue-HDi Club M',
 'transmission': 'automatic',
 'trim': 'Club M',
 'year': 2021}
2026-03-29 12:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YB88576%27 HTTP/1.1" 200 None
2026-03-29 12:01:37 [auto1.nl] INFO: Saving data for YB88576: {'auction_closing_time': 1774883607.0, 'created_time': 1774699259.267465, 'last_price_update_time': 1774785697.892336}
2026-03-29 12:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='YB88576') HTTP/1.1" 204 0
2026-03-29 12:01:37 [auto1.nl] INFO: Channel: 24h | Page: 20 | totalHits: 759 | hits on page: 0
2026-03-29 12:01:37 [auto1.nl] INFO: Found listing with ID: YG37971
2026-03-29 12:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YG37971%27 HTTP/1.1" 200 None
2026-03-29 12:01:37 [auto1.nl] INFO: Scrape type for YG37971: 2
2026-03-29 12:01:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4cacd395-a1ad-5602-87f2-8ffb1476e019 with identifier: YG37971
2026-03-29 12:01:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4cacd395-a1ad-5602-87f2-8ffb1476e019 with scrape type 2
2026-03-29 12:01:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4cacd395-a1ad-5602-87f2-8ffb1476e019 with scrape type 2
2026-03-29 12:01:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 4cacd395-a1ad-5602-87f2-8ffb1476e019, identifier: YG37971
2026-03-29 12:01:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 4cacd395-a1ad-5602-87f2-8ffb1476e019 with identifier: YG37971
2026-03-29 12:01:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 4cacd395-a1ad-5602-87f2-8ffb1476e019 with identifier: YG37971
2026-03-29 12:01:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 4cacd395-a1ad-5602-87f2-8ffb1476e019 with identifier: YG37971 to the API
2026-03-29 12:01:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 12:01:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 12:01:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 160,
 'expiration_date': '2026-03-30T15:57:09Z',
 'fuel_type': 'petrol',
 'id': '4cacd395-a1ad-5602-87f2-8ffb1476e019',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YG37971',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Mondeo',
 'odometer': 343295,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-03-20',
 'seller_name': None,
 'title': 'Ford Mondeo 2.3 Titanium',
 'transmission': 'automatic',
 'trim': 'Titanium',
 'year': 2008}
2026-03-29 12:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YG37971%27 HTTP/1.1" 200 None
2026-03-29 12:01:38 [auto1.nl] INFO: Saving data for YG37971: {'auction_closing_time': 1774886229.0, 'created_time': 1774699252.077458, 'last_price_update_time': 1774785698.282505}
2026-03-29 12:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='YG37971') HTTP/1.1" 204 0
2026-03-29 12:01:38 [auto1.nl] INFO: Found listing with ID: UF88780
2026-03-29 12:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UF88780%27 HTTP/1.1" 200 None
2026-03-29 12:01:38 [auto1.nl] INFO: Scrape type for UF88780: 2
2026-03-29 12:01:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 08939ddd-895c-578d-a6d4-0334c2d14419 with identifier: UF88780
2026-03-29 12:01:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 08939ddd-895c-578d-a6d4-0334c2d14419 with scrape type 2
2026-03-29 12:01:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 08939ddd-895c-578d-a6d4-0334c2d14419 with scrape type 2
2026-03-29 12:01:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 08939ddd-895c-578d-a6d4-0334c2d14419, identifier: UF88780
2026-03-29 12:01:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 08939ddd-895c-578d-a6d4-0334c2d14419 with identifier: UF88780
2026-03-29 12:01:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 08939ddd-895c-578d-a6d4-0334c2d14419 with identifier: UF88780
2026-03-29 12:01:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 08939ddd-895c-578d-a6d4-0334c2d14419 with identifier: UF88780 to the API
2026-03-29 12:01:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 12:01:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 12:01:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 230,
 'expiration_date': '2026-03-30T15:44:30Z',
 'fuel_type': 'hybrid',
 'id': '08939ddd-895c-578d-a6d4-0334c2d14419',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UF88780',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'Tucson',
 'odometer': 60311,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-03-30',
 'seller_name': None,
 'title': 'Hyundai Tucson 1.6 T-GDI Hybrid Smart 2WD',
 'transmission': 'automatic',
 'trim': 'Smart 2WD',
 'year': 2021}
2026-03-29 12:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UF88780%27 HTTP/1.1" 200 None
2026-03-29 12:01:38 [auto1.nl] INFO: Saving data for UF88780: {'auction_closing_time': 1774885470.0, 'created_time': 1774699261.697784, 'last_price_update_time': 1774785698.703816}
2026-03-29 12:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='UF88780') HTTP/1.1" 204 0
2026-03-29 12:01:38 [auto1.nl] INFO: Found listing with ID: WK03460
2026-03-29 12:01:38 [auto1.nl] INFO: Found listing with ID: FG02230
2026-03-29 12:01:38 [auto1.nl] INFO: Found listing with ID: KC88699
2026-03-29 12:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KC88699%27 HTTP/1.1" 200 None
2026-03-29 12:01:38 [auto1.nl] INFO: Scrape type for KC88699: 2
2026-03-29 12:01:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e2b24f0d-13c4-59a9-9eef-98f364879240 with identifier: KC88699
2026-03-29 12:01:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e2b24f0d-13c4-59a9-9eef-98f364879240 with scrape type 2
2026-03-29 12:01:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e2b24f0d-13c4-59a9-9eef-98f364879240 with scrape type 2
2026-03-29 12:01:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: e2b24f0d-13c4-59a9-9eef-98f364879240, identifier: KC88699
2026-03-29 12:01:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: e2b24f0d-13c4-59a9-9eef-98f364879240 with identifier: KC88699
2026-03-29 12:01:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: e2b24f0d-13c4-59a9-9eef-98f364879240 with identifier: KC88699
2026-03-29 12:01:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: e2b24f0d-13c4-59a9-9eef-98f364879240 with identifier: KC88699 to the API
2026-03-29 12:01:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 12:01:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 12:01:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-30T15:50:50Z',
 'fuel_type': 'petrol',
 'id': 'e2b24f0d-13c4-59a9-9eef-98f364879240',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KC88699',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 185215,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2006-10-01',
 'seller_name': None,
 'title': 'Ford Focus 1.6 Sport',
 'transmission': 'automatic',
 'trim': 'Sport',
 'year': 2006}
2026-03-29 12:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KC88699%27 HTTP/1.1" 200 None
2026-03-29 12:01:39 [auto1.nl] INFO: Saving data for KC88699: {'auction_closing_time': 1774885850.0, 'created_time': 1774699257.31802, 'last_price_update_time': 1774785699.12251}
2026-03-29 12:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='KC88699') HTTP/1.1" 204 0
2026-03-29 12:01:39 [auto1.nl] INFO: Found listing with ID: NX59327
2026-03-29 12:01:39 [auto1.nl] INFO: Found listing with ID: AB36156
2026-03-29 12:01:39 [auto1.nl] INFO: Found listing with ID: WZ79997
2026-03-29 12:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WZ79997%27 HTTP/1.1" 200 None
2026-03-29 12:01:39 [auto1.nl] INFO: Scrape type for WZ79997: 2
2026-03-29 12:01:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5cdc7a4e-f9a5-5f10-a4de-a7a486da8f67 with identifier: WZ79997
2026-03-29 12:01:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5cdc7a4e-f9a5-5f10-a4de-a7a486da8f67 with scrape type 2
2026-03-29 12:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5cdc7a4e-f9a5-5f10-a4de-a7a486da8f67 with scrape type 2
2026-03-29 12:01:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 5cdc7a4e-f9a5-5f10-a4de-a7a486da8f67, identifier: WZ79997
2026-03-29 12:01:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 5cdc7a4e-f9a5-5f10-a4de-a7a486da8f67 with identifier: WZ79997
2026-03-29 12:01:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 5cdc7a4e-f9a5-5f10-a4de-a7a486da8f67 with identifier: WZ79997
2026-03-29 12:01:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 5cdc7a4e-f9a5-5f10-a4de-a7a486da8f67 with identifier: WZ79997 to the API
2026-03-29 12:01:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 12:01:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 12:01:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 340,
 'expiration_date': '2026-03-30T15:29:27Z',
 'fuel_type': 'petrol',
 'id': '5cdc7a4e-f9a5-5f10-a4de-a7a486da8f67',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WZ79997',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'Z4',
 'odometer': 131843,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-09-06',
 'seller_name': None,
 'title': 'BMW Z4 sDrive 35is',
 'transmission': 'automatic',
 'trim': '',
 'year': 2012}
2026-03-29 12:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WZ79997%27 HTTP/1.1" 200 None
2026-03-29 12:01:39 [auto1.nl] INFO: Saving data for WZ79997: {'auction_closing_time': 1774884567.0, 'created_time': 1774699281.997488, 'last_price_update_time': 1774785699.531708}
2026-03-29 12:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='WZ79997') HTTP/1.1" 204 0
2026-03-29 12:01:39 [auto1.nl] INFO: Found listing with ID: JW97628
2026-03-29 12:01:39 [auto1.nl] INFO: Found listing with ID: MP39959
2026-03-29 12:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MP39959%27 HTTP/1.1" 200 None
2026-03-29 12:01:39 [auto1.nl] INFO: Scrape type for MP39959: 0
2026-03-29 12:01:39 [auto1.nl] INFO: Found listing with ID: YN95467
2026-03-29 12:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YN95467%27 HTTP/1.1" 200 None
2026-03-29 12:01:39 [auto1.nl] INFO: Scrape type for YN95467: 2
2026-03-29 12:01:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 23b806ca-e617-5017-9a8f-cf159d2a0074 with identifier: YN95467
2026-03-29 12:01:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 23b806ca-e617-5017-9a8f-cf159d2a0074 with scrape type 2
2026-03-29 12:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 23b806ca-e617-5017-9a8f-cf159d2a0074 with scrape type 2
2026-03-29 12:01:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 23b806ca-e617-5017-9a8f-cf159d2a0074, identifier: YN95467
2026-03-29 12:01:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 23b806ca-e617-5017-9a8f-cf159d2a0074 with identifier: YN95467
2026-03-29 12:01:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 23b806ca-e617-5017-9a8f-cf159d2a0074 with identifier: YN95467
2026-03-29 12:01:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 23b806ca-e617-5017-9a8f-cf159d2a0074 with identifier: YN95467 to the API
2026-03-29 12:01:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 12:01:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 12:01:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 163,
 'expiration_date': '2026-03-30T15:11:45Z',
 'fuel_type': 'petrol',
 'id': '23b806ca-e617-5017-9a8f-cf159d2a0074',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YN95467',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'SLK-Klasse',
 'odometer': 339212,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2002-06-02',
 'seller_name': None,
 'title': 'Mercedes-Benz SLK-Klasse SLK 200 Kompressor',
 'transmission': 'automatic',
 'trim': '',
 'year': 2002}
2026-03-29 12:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YN95467%27 HTTP/1.1" 200 None
2026-03-29 12:01:39 [auto1.nl] INFO: Saving data for YN95467: {'auction_closing_time': 1774883505.0, 'created_time': 1773343671.482367, 'last_price_update_time': 1774785699.946217}
2026-03-29 12:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='YN95467') HTTP/1.1" 204 0
2026-03-29 12:01:40 [auto1.nl] INFO: Found listing with ID: LR40141
2026-03-29 12:01:40 [auto1.nl] INFO: Found listing with ID: AW17903
2026-03-29 12:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AW17903%27 HTTP/1.1" 200 None
2026-03-29 12:01:40 [auto1.nl] INFO: Scrape type for AW17903: 2
2026-03-29 12:01:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2e7d487d-b708-5833-a488-56123a041330 with identifier: AW17903
2026-03-29 12:01:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2e7d487d-b708-5833-a488-56123a041330 with scrape type 2
2026-03-29 12:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2e7d487d-b708-5833-a488-56123a041330 with scrape type 2
2026-03-29 12:01:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 2e7d487d-b708-5833-a488-56123a041330, identifier: AW17903
2026-03-29 12:01:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 2e7d487d-b708-5833-a488-56123a041330 with identifier: AW17903
2026-03-29 12:01:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 2e7d487d-b708-5833-a488-56123a041330 with identifier: AW17903
2026-03-29 12:01:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 2e7d487d-b708-5833-a488-56123a041330 with identifier: AW17903 to the API
2026-03-29 12:01:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 12:01:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 12:01:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 155,
 'expiration_date': '2026-03-30T15:05:39Z',
 'fuel_type': 'petrol',
 'id': '2e7d487d-b708-5833-a488-56123a041330',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AW17903',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Puma',
 'odometer': 91578,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-06-21',
 'seller_name': None,
 'title': 'Ford Puma 1.0 EcoBoost Mild-Hybrid ST-Line X',
 'transmission': 'automatic',
 'trim': 'ST-Line X',
 'year': 2021}
2026-03-29 12:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AW17903%27 HTTP/1.1" 200 None
2026-03-29 12:01:40 [auto1.nl] INFO: Saving data for AW17903: {'auction_closing_time': 1774883139.0, 'created_time': 1774699276.004827, 'last_price_update_time': 1774785700.785249}
2026-03-29 12:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='AW17903') HTTP/1.1" 204 0
2026-03-29 12:01:40 [auto1.nl] INFO: Found listing with ID: EP93197
2026-03-29 12:01:40 [auto1.nl] INFO: Found listing with ID: DT42929
2026-03-29 12:01:40 [auto1.nl] INFO: Found listing with ID: NC22018
2026-03-29 12:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NC22018%27 HTTP/1.1" 200 None
2026-03-29 12:01:40 [auto1.nl] INFO: Scrape type for NC22018: 2
2026-03-29 12:01:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 992869ee-8e19-5896-bff5-5f5d685d7384 with identifier: NC22018
2026-03-29 12:01:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 992869ee-8e19-5896-bff5-5f5d685d7384 with scrape type 2
2026-03-29 12:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 992869ee-8e19-5896-bff5-5f5d685d7384 with scrape type 2
2026-03-29 12:01:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 992869ee-8e19-5896-bff5-5f5d685d7384, identifier: NC22018
2026-03-29 12:01:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 992869ee-8e19-5896-bff5-5f5d685d7384 with identifier: NC22018
2026-03-29 12:01:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 992869ee-8e19-5896-bff5-5f5d685d7384 with identifier: NC22018
2026-03-29 12:01:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 992869ee-8e19-5896-bff5-5f5d685d7384 with identifier: NC22018 to the API
2026-03-29 12:01:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 12:01:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 12:01:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 136,
 'expiration_date': '2026-03-30T15:52:24Z',
 'fuel_type': 'petrol',
 'id': '992869ee-8e19-5896-bff5-5f5d685d7384',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NC22018',
 'listing': 'auction',
 'make': 'MINI',
 'model': 'MINI',
 'odometer': 58238,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-02-20',
 'seller_name': None,
 'title': 'MINI Cooper 60 Years',
 'transmission': 'automatic',
 'trim': '60 Years',
 'year': 2020}
2026-03-29 12:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NC22018%27 HTTP/1.1" 200 None
2026-03-29 12:01:41 [auto1.nl] INFO: Saving data for NC22018: {'auction_closing_time': 1774885944.0, 'created_time': 1773343175.476087, 'last_price_update_time': 1774785701.260062}
2026-03-29 12:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='NC22018') HTTP/1.1" 204 0
2026-03-29 12:01:41 [auto1.nl] INFO: Found listing with ID: AV73218
2026-03-29 12:01:41 [auto1.nl] INFO: Found listing with ID: ZG49112
2026-03-29 12:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZG49112%27 HTTP/1.1" 200 None
2026-03-29 12:01:41 [auto1.nl] INFO: Scrape type for ZG49112: 2
2026-03-29 12:01:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7cfef7af-d3d7-5803-87eb-e023b45625af with identifier: ZG49112
2026-03-29 12:01:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7cfef7af-d3d7-5803-87eb-e023b45625af with scrape type 2
2026-03-29 12:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7cfef7af-d3d7-5803-87eb-e023b45625af with scrape type 2
2026-03-29 12:01:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 7cfef7af-d3d7-5803-87eb-e023b45625af, identifier: ZG49112
2026-03-29 12:01:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 7cfef7af-d3d7-5803-87eb-e023b45625af with identifier: ZG49112
2026-03-29 12:01:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 7cfef7af-d3d7-5803-87eb-e023b45625af with identifier: ZG49112
2026-03-29 12:01:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 7cfef7af-d3d7-5803-87eb-e023b45625af with identifier: ZG49112 to the API
2026-03-29 12:01:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-29 12:01:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-29 12:01:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 82,
 'expiration_date': '2026-03-30T15:54:15Z',
 'fuel_type': 'petrol',
 'id': '7cfef7af-d3d7-5803-87eb-e023b45625af',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZG49112',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C3',
 'odometer': 85608,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-12-23',
 'seller_name': None,
 'title': 'Citroen C3 1.2 PureTech Feel',
 'transmission': 'manual',
 'trim': 'Feel',
 'year': 2016}
2026-03-29 12:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZG49112%27 HTTP/1.1" 200 None
2026-03-29 12:01:41 [auto1.nl] INFO: Saving data for ZG49112: {'auction_closing_time': 1774886055.0, 'created_time': 1774699279.708487, 'last_price_update_time': 1774785701.670878}
2026-03-29 12:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='ZG49112') HTTP/1.1" 204 0
2026-03-29 12:01:41 [scrapy.core.engine] INFO: Closing spider (finished)
2026-03-29 12:01:41 [auto1.nl] INFO: auto1.nl Batch config: batch 1/2
2026-03-29 12:01:41 [auto1.nl] INFO: auto1.nl Crawl ended with reason finished, scrape types: {<ScrapeType.NEW: 1>: 0, <ScrapeType.NEW_DUPLICATE_ID: 4>: 0, <ScrapeType.PRICE_UPDATE: 2>: 3, <ScrapeType.AUCTION_UPDATE: 3>: 0, <ScrapeType.SKIPPED: 0>: 0, <ScrapeType.BATCH_SKIPPED: 5>: 4}
2026-03-29 12:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-29 12:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20last_price_update_time%20lt%201774353701 HTTP/1.1" 200 None
2026-03-29 12:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='CL75816') HTTP/1.1" 204 0
2026-03-29 12:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='EG63520') HTTP/1.1" 204 0
2026-03-29 12:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='EJ69380') HTTP/1.1" 204 0
2026-03-29 12:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='EL20834') HTTP/1.1" 204 0
2026-03-29 12:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='KE60689') HTTP/1.1" 204 0
2026-03-29 12:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='MJ91840') HTTP/1.1" 204 0
2026-03-29 12:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='NA96698') HTTP/1.1" 204 0
2026-03-29 12:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='NJ54414') HTTP/1.1" 204 0
2026-03-29 12:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='PM53437') HTTP/1.1" 204 0
2026-03-29 12:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='SA32681') HTTP/1.1" 204 0
2026-03-29 12:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='YB99145') HTTP/1.1" 204 0
2026-03-29 12:01:42 [scrapy.extensions.feedexport] INFO: Stored jsonlines feed (111 items) in: file:///var/lib/scrapyd/items/sourcing_v2/auto1.nl/task_27_2026-03-29T12_00_00.jl
2026-03-29 12:01:42 [scrapy.statscollectors] INFO: Dumping Scrapy stats:
{'downloader/request_bytes': 112835,
 'downloader/request_count': 46,
 'downloader/request_method_count/GET': 24,
 'downloader/request_method_count/POST': 22,
 'downloader/response_bytes': 3781207,
 'downloader/response_count': 46,
 'downloader/response_status_count/200': 46,
 'dupefilter/filtered': 2,
 'elapsed_time_seconds': 94.993728,
 'feedexport/success_count/FileFeedStorage': 1,
 'finish_reason': 'finished',
 'finish_time': datetime.datetime(2026, 3, 29, 12, 1, 41, 932706, tzinfo=datetime.timezone.utc),
 'item_scraped_count': 111,
 'log_count/DEBUG': 1893,
 'log_count/INFO': 2239,
 'memusage/max': 168071168,
 'memusage/startup': 149757952,
 'request_depth_max': 23,
 'response_received_count': 46,
 'scheduler/dequeued': 46,
 'scheduler/dequeued/memory': 46,
 'scheduler/enqueued': 46,
 'scheduler/enqueued/memory': 46,
 'scrape_type/batch_skipped': 396,
 'scrape_type/new': 11,
 'scrape_type/price_update': 100,
 'scrape_type/skipped': 290,
 'scrapy-zyte-api/429': 0,
 'scrapy-zyte-api/attempts': 46,
 'scrapy-zyte-api/error_ratio': 0.0,
 'scrapy-zyte-api/errors': 0,
 'scrapy-zyte-api/fatal_errors': 0,
 'scrapy-zyte-api/mean_connection_seconds': 3.357504553596854,
 'scrapy-zyte-api/mean_response_seconds': 3.4015091789845857,
 'scrapy-zyte-api/processed': 46,
 'scrapy-zyte-api/request_args/customHttpRequestHeaders': 46,
 'scrapy-zyte-api/request_args/experimental.requestCookies': 45,
 'scrapy-zyte-api/request_args/experimental.responseCookies': 46,
 'scrapy-zyte-api/request_args/httpRequestBody': 22,
 'scrapy-zyte-api/request_args/httpRequestMethod': 22,
 'scrapy-zyte-api/request_args/httpResponseBody': 46,
 'scrapy-zyte-api/request_args/httpResponseHeaders': 46,
 'scrapy-zyte-api/request_args/sessionContext': 46,
 'scrapy-zyte-api/request_args/url': 46,
 'scrapy-zyte-api/status_codes/200': 46,
 'scrapy-zyte-api/success': 46,
 'scrapy-zyte-api/success_ratio': 1.0,
 'scrapy-zyte-api/throttle_ratio': 0.0,
 'source/items_encountered': 799,
 'source/total_available': 759,
 'start_time': datetime.datetime(2026, 3, 29, 12, 0, 6, 938978, tzinfo=datetime.timezone.utc)}
2026-03-29 12:01:42 [scrapy.core.engine] INFO: Spider closed (finished)
2026-03-29 12:01:42 [asyncio] ERROR: Unclosed client session
client_session: <aiohttp.client.ClientSession object at 0x7f0ff7335a90>
2026-03-29 12:01:42 [asyncio] ERROR: Unclosed client session
client_session: <aiohttp.client.ClientSession object at 0x7f0ff7463d50>