2026-03-28 05:00:06 [scrapy.utils.log] INFO: Scrapy 2.11.2 started (bot: SourcingV2)
2026-03-28 05:00:06 [scrapy.utils.log] INFO: Versions: lxml 5.2.2.0, libxml2 2.12.6, cssselect 1.2.0, parsel 1.9.1, w3lib 2.1.2, Twisted 24.3.0, Python 3.11.2 (main, Mar 13 2023, 12:18:29) [GCC 12.2.0], pyOpenSSL 24.1.0 (OpenSSL 3.2.1 30 Jan 2024), cryptography 42.0.7, Platform Linux-5.15.0-1098-azure-x86_64-with-glibc2.36
2026-03-28 05:00:06 [auto1.nl] INFO: Batch mode enabled: batch 1/2
2026-03-28 05:00:06 [auto1.nl] INFO: Starting spider auto1.nl
2026-03-28 05:00:06 [scrapy.addons] INFO: Enabled addons:
[]
2026-03-28 05:00:06 [asyncio] DEBUG: Using selector: EpollSelector
2026-03-28 05:00:06 [scrapy.utils.log] DEBUG: Using reactor: twisted.internet.asyncioreactor.AsyncioSelectorReactor
2026-03-28 05:00:06 [scrapy.utils.log] DEBUG: Using asyncio event loop: asyncio.unix_events._UnixSelectorEventLoop
2026-03-28 05:00:06 [scrapy.extensions.telnet] INFO: Telnet Password: ac4e336430f36345
2026-03-28 05:00:06 [scrapy.middleware] INFO: Enabled extensions:
['scrapy.extensions.corestats.CoreStats',
 'scrapy.extensions.telnet.TelnetConsole',
 'scrapy.extensions.memusage.MemoryUsage',
 'scrapy.extensions.feedexport.FeedExporter',
 'scrapy.extensions.logstats.LogStats',
 'scrapy.extensions.closespider.CloseSpider']
2026-03-28 05:00:06 [scrapy.crawler] INFO: Overridden settings:
{'BOT_NAME': 'SourcingV2',
 'CLOSESPIDER_TIMEOUT': 7200,
 'DOWNLOAD_MAXSIZE': 52428800,
 'DOWNLOAD_WARNSIZE': 10485760,
 'FEED_EXPORT_ENCODING': 'utf-8',
 'LOG_FILE': '/var/log/scrapyd/logs/sourcing_v2/auto1.nl/task_27_2026-03-28T05_00_00.log',
 'LOG_FORMATTER': 'crawlers.log_formatter.SourcingLogFormatter',
 'MEMUSAGE_LIMIT_MB': 2048,
 'MEMUSAGE_WARNING_MB': 1536,
 'NEWSPIDER_MODULE': 'spiders',
 'REQUEST_FINGERPRINTER_CLASS': 'scrapy_zyte_api.ScrapyZyteAPIRequestFingerprinter',
 'REQUEST_FINGERPRINTER_IMPLEMENTATION': '2.7',
 'SPIDER_MODULES': ['spiders', 'auth_check'],
 'TWISTED_REACTOR': 'twisted.internet.asyncioreactor.AsyncioSelectorReactor',
 'USER_AGENT': ''}
2026-03-28 05:00:06 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2026-03-28 05:00:06 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2026-03-28 05:00:06 [scrapy.middleware] INFO: Enabled downloader middlewares:
['scrapy.downloadermiddlewares.offsite.OffsiteMiddleware',
 'scrapy.downloadermiddlewares.httpauth.HttpAuthMiddleware',
 'scrapy.downloadermiddlewares.downloadtimeout.DownloadTimeoutMiddleware',
 'scrapy.downloadermiddlewares.defaultheaders.DefaultHeadersMiddleware',
 'scrapy.downloadermiddlewares.useragent.UserAgentMiddleware',
 'scrapy_zyte_api.ScrapyZyteAPIDownloaderMiddleware',
 'scrapy.downloadermiddlewares.retry.RetryMiddleware',
 'scrapy.downloadermiddlewares.redirect.MetaRefreshMiddleware',
 'scrapy.downloadermiddlewares.httpcompression.HttpCompressionMiddleware',
 'scrapy.downloadermiddlewares.redirect.RedirectMiddleware',
 'scrapy.downloadermiddlewares.cookies.CookiesMiddleware',
 'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware',
 'scrapy.downloadermiddlewares.stats.DownloaderStats']
2026-03-28 05:00:06 [crawlers.middlewares.id_gen_middleware] INFO: Setting up IdGenerationMiddleware
2026-03-28 05:00:06 [scrapy.middleware] INFO: Enabled spider middlewares:
['scrapy.spidermiddlewares.httperror.HttpErrorMiddleware',
 'scrapy_zyte_api.ScrapyZyteAPISpiderMiddleware',
 'crawlers.middlewares.monitoring_spider_middleware.MonitoringSpiderMiddleware',
 'scrapy.spidermiddlewares.referer.RefererMiddleware',
 'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware',
 'scrapy.spidermiddlewares.depth.DepthMiddleware',
 'crawlers.middlewares.photo_download_middleware.PhotoDownloadMiddleware',
 'crawlers.middlewares.report_download_middleware.ReportDownloadMiddleware',
 'crawlers.middlewares.id_gen_middleware.IdGenMiddleware']
2026-03-28 05:00:06 [azure.identity._credentials.environment] INFO: Incomplete environment configuration for EnvironmentCredential. These variables are set: AZURE_CLIENT_ID, AZURE_TENANT_ID
2026-03-28 05:00:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-03-28 05:00:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2118
2026-03-28 05:00:06 [azure.identity._credentials.chained] INFO: DefaultAzureCredential acquired a token from WorkloadIdentityCredential
2026-03-28 05:00:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxsourcingstorageprod.table.core.windows.net:443
2026-03-28 05:00:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:00:07 [crawlers.pipelines.translation_pipeline] INFO: Loading translations for language: auto
2026-03-28 05:00:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /Translations()?$filter=PartitionKey%20eq%20%27auto%27%20and%20RowKey%20eq%20%27auto%27 HTTP/1.1" 200 None
2026-03-28 05:00:07 [crawlers.pipelines.item_rules_pipeline] INFO: Setting up ItemRules Pipeline
2026-03-28 05:00:07 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_location_for_country.json
2026-03-28 05:00:07 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: damaged_cars_from_auction_title.json
2026-03-28 05:00:07 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_country.json
2026-03-28 05:00:07 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_fr.json
2026-03-28 05:00:07 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_photos.json
2026-03-28 05:00:07 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: damaged_from_info.json
2026-03-28 05:00:07 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: makes_not_allowed.json
2026-03-28 05:00:07 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: not_operable_from_info.json
2026-03-28 05:00:07 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: makes_models_not_allowed.json
2026-03-28 05:00:07 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: keywords_from_title.json
2026-03-28 05:00:07 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: imported_cars.json
2026-03-28 05:00:07 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_currency.json
2026-03-28 05:00:07 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_mileage.json
2026-03-28 05:00:07 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: keywords_from_auction_title.json
2026-03-28 05:00:07 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_country_of_origin.json
2026-03-28 05:00:07 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_pt.json
2026-03-28 05:00:07 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: electric_cars.json
2026-03-28 05:00:07 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_color.json
2026-03-28 05:00:07 [crawlers.pipelines.post_to_api] INFO: Setting up PostToApi Pipeline pointing to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
2026-03-28 05:00:07 [scrapy.middleware] INFO: Enabled item pipelines:
['crawlers.pipelines.translation_pipeline.TranslationPipeline',
 'crawlers.pipelines.item_rules_pipeline.ItemRulesPipeline',
 'crawlers.pipelines.post_to_api.PostToApiPipeline']
2026-03-28 05:00:07 [scrapy.core.engine] INFO: Spider opened
2026-03-28 05:00:07 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2026-03-28 05:00:07 [scrapy.extensions.telnet] INFO: Telnet console listening on 127.0.0.1:6023
2026-03-28 05:00:07 [scrapy.extensions.memusage] INFO: Peak memory usage is 140MiB
2026-03-28 05:00:07 [scrapy-playwright] INFO: Starting download handler
2026-03-28 05:00:07 [scrapy-playwright] INFO: Starting download handler
2026-03-28 05:00:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:00:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/home> (referer: None) ['zyte-api']
2026-03-28 05:00:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:00:44 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/en/merchant/signin/ajax> (referer: https://www.auto1.com/en/home) ['zyte-api']
2026-03-28 05:00:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:00:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/user-token/obtain-token> (referer: https://www.auto1.com/en/merchant/signin/ajax) ['zyte-api']
2026-03-28 05:00:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:00:46 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/en/app/user-token/obtain-token) ['zyte-api']
2026-03-28 05:00:46 [auto1.nl] INFO: Channel: 24h | Page: 0 | totalHits: 917 | hits on page: 40
2026-03-28 05:00:46 [auto1.nl] INFO: Found listing with ID: JH98357
2026-03-28 05:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JH98357%27 HTTP/1.1" 200 None
2026-03-28 05:00:46 [auto1.nl] INFO: Scrape type for JH98357: 0
2026-03-28 05:00:46 [auto1.nl] INFO: Found listing with ID: XW85568
2026-03-28 05:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XW85568%27 HTTP/1.1" 200 None
2026-03-28 05:00:46 [auto1.nl] INFO: Scrape type for XW85568: 2
2026-03-28 05:00:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fae5ccfd-3899-52cc-93de-6d0dd8a5377c with identifier: XW85568
2026-03-28 05:00:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fae5ccfd-3899-52cc-93de-6d0dd8a5377c with scrape type 2
2026-03-28 05:00:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fae5ccfd-3899-52cc-93de-6d0dd8a5377c with scrape type 2
2026-03-28 05:00:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: fae5ccfd-3899-52cc-93de-6d0dd8a5377c, identifier: XW85568
2026-03-28 05:00:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: fae5ccfd-3899-52cc-93de-6d0dd8a5377c with identifier: XW85568
2026-03-28 05:00:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 05:00:46 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=silver HTTP/1.1" 200 None
2026-03-28 05:00:46 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 05:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 05:00:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 05:00:46 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=petrol HTTP/1.1" 200 None
2026-03-28 05:00:46 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 05:00:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 05:00:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: fae5ccfd-3899-52cc-93de-6d0dd8a5377c with identifier: XW85568
2026-03-28 05:00:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: fae5ccfd-3899-52cc-93de-6d0dd8a5377c with identifier: XW85568 to the API
2026-03-28 05:00:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:00:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:00:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'silver',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 445,
 'expiration_date': '2026-03-28T16:18:13Z',
 'fuel_type': 'petrol',
 'id': 'fae5ccfd-3899-52cc-93de-6d0dd8a5377c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XW85568',
 'listing': 'auction',
 'make': 'BMW',
 'model': '7er',
 'odometer': 91604,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2003-08-31',
 'seller_name': None,
 'title': 'BMW 7er 760i L',
 'transmission': 'automatic',
 'trim': 'L',
 'year': 2003}
2026-03-28 05:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XW85568%27 HTTP/1.1" 200 None
2026-03-28 05:00:47 [auto1.nl] INFO: Saving data for XW85568: {'auction_closing_time': 1774714693.0, 'created_time': 1774267359.071202, 'last_price_update_time': 1774674047.104092}
2026-03-28 05:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='XW85568') HTTP/1.1" 204 0
2026-03-28 05:00:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:00:47 [auto1.nl] INFO: Found listing with ID: ET91545
2026-03-28 05:00:47 [auto1.nl] INFO: Found listing with ID: TF89424
2026-03-28 05:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TF89424%27 HTTP/1.1" 200 None
2026-03-28 05:00:47 [auto1.nl] INFO: Scrape type for TF89424: 0
2026-03-28 05:00:47 [auto1.nl] INFO: Found listing with ID: VC45761
2026-03-28 05:00:47 [auto1.nl] INFO: Found listing with ID: CT54062
2026-03-28 05:00:47 [auto1.nl] INFO: Found listing with ID: AR13994
2026-03-28 05:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AR13994%27 HTTP/1.1" 200 None
2026-03-28 05:00:47 [auto1.nl] INFO: Scrape type for AR13994: 0
2026-03-28 05:00:47 [auto1.nl] INFO: Found listing with ID: CA41421
2026-03-28 05:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CA41421%27 HTTP/1.1" 200 None
2026-03-28 05:00:47 [auto1.nl] INFO: Scrape type for CA41421: 0
2026-03-28 05:00:47 [auto1.nl] INFO: Found listing with ID: EX94963
2026-03-28 05:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EX94963%27 HTTP/1.1" 200 None
2026-03-28 05:00:47 [auto1.nl] INFO: Scrape type for EX94963: 0
2026-03-28 05:00:47 [auto1.nl] INFO: Found listing with ID: ZA54727
2026-03-28 05:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZA54727%27 HTTP/1.1" 200 None
2026-03-28 05:00:47 [auto1.nl] INFO: Scrape type for ZA54727: 0
2026-03-28 05:00:47 [auto1.nl] INFO: Found listing with ID: BX02996
2026-03-28 05:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BX02996%27 HTTP/1.1" 200 None
2026-03-28 05:00:47 [auto1.nl] INFO: Scrape type for BX02996: 0
2026-03-28 05:00:47 [auto1.nl] INFO: Found listing with ID: RY27630
2026-03-28 05:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RY27630%27 HTTP/1.1" 200 None
2026-03-28 05:00:47 [auto1.nl] INFO: Scrape type for RY27630: 0
2026-03-28 05:00:47 [auto1.nl] INFO: Found listing with ID: RJ64387
2026-03-28 05:00:47 [auto1.nl] INFO: Found listing with ID: FE12544
2026-03-28 05:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FE12544%27 HTTP/1.1" 200 None
2026-03-28 05:00:47 [auto1.nl] INFO: Scrape type for FE12544: 0
2026-03-28 05:00:47 [auto1.nl] INFO: Found listing with ID: GL59810
2026-03-28 05:00:47 [auto1.nl] INFO: Found listing with ID: CG41463
2026-03-28 05:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CG41463%27 HTTP/1.1" 200 None
2026-03-28 05:00:47 [auto1.nl] INFO: Scrape type for CG41463: 0
2026-03-28 05:00:47 [auto1.nl] INFO: Found listing with ID: FV36091
2026-03-28 05:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FV36091%27 HTTP/1.1" 200 None
2026-03-28 05:00:47 [auto1.nl] INFO: Scrape type for FV36091: 0
2026-03-28 05:00:47 [auto1.nl] INFO: Found listing with ID: SJ21377
2026-03-28 05:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SJ21377%27 HTTP/1.1" 200 None
2026-03-28 05:00:47 [auto1.nl] INFO: Scrape type for SJ21377: 0
2026-03-28 05:00:47 [auto1.nl] INFO: Found listing with ID: PG19961
2026-03-28 05:00:47 [auto1.nl] INFO: Found listing with ID: YW05960
2026-03-28 05:00:47 [auto1.nl] INFO: Found listing with ID: MM65316
2026-03-28 05:00:47 [auto1.nl] INFO: Found listing with ID: DG42232
2026-03-28 05:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DG42232%27 HTTP/1.1" 200 None
2026-03-28 05:00:47 [auto1.nl] INFO: Scrape type for DG42232: 0
2026-03-28 05:00:47 [auto1.nl] INFO: Found listing with ID: VX32369
2026-03-28 05:00:47 [auto1.nl] INFO: Found listing with ID: NJ80961
2026-03-28 05:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NJ80961%27 HTTP/1.1" 200 None
2026-03-28 05:00:47 [auto1.nl] INFO: Scrape type for NJ80961: 0
2026-03-28 05:00:47 [auto1.nl] INFO: Found listing with ID: PL67988
2026-03-28 05:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PL67988%27 HTTP/1.1" 200 None
2026-03-28 05:00:47 [auto1.nl] INFO: Scrape type for PL67988: 0
2026-03-28 05:00:47 [auto1.nl] INFO: Found listing with ID: EU22503
2026-03-28 05:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EU22503%27 HTTP/1.1" 200 None
2026-03-28 05:00:47 [auto1.nl] INFO: Scrape type for EU22503: 0
2026-03-28 05:00:47 [auto1.nl] INFO: Found listing with ID: CS76145
2026-03-28 05:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CS76145%27 HTTP/1.1" 200 None
2026-03-28 05:00:47 [auto1.nl] INFO: Scrape type for CS76145: 0
2026-03-28 05:00:47 [auto1.nl] INFO: Found listing with ID: YP02517
2026-03-28 05:00:47 [auto1.nl] INFO: Found listing with ID: NR59954
2026-03-28 05:00:47 [auto1.nl] INFO: Found listing with ID: GA85229
2026-03-28 05:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GA85229%27 HTTP/1.1" 200 None
2026-03-28 05:00:47 [auto1.nl] INFO: Scrape type for GA85229: 0
2026-03-28 05:00:47 [auto1.nl] INFO: Found listing with ID: EH14183
2026-03-28 05:00:47 [auto1.nl] INFO: Found listing with ID: CK37627
2026-03-28 05:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CK37627%27 HTTP/1.1" 200 None
2026-03-28 05:00:47 [auto1.nl] INFO: Scrape type for CK37627: 0
2026-03-28 05:00:47 [auto1.nl] INFO: Found listing with ID: UE74675
2026-03-28 05:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UE74675%27 HTTP/1.1" 200 None
2026-03-28 05:00:47 [auto1.nl] INFO: Scrape type for UE74675: 0
2026-03-28 05:00:47 [auto1.nl] INFO: Found listing with ID: LA17019
2026-03-28 05:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LA17019%27 HTTP/1.1" 200 None
2026-03-28 05:00:47 [auto1.nl] INFO: Scrape type for LA17019: 0
2026-03-28 05:00:47 [auto1.nl] INFO: Found listing with ID: VD03329
2026-03-28 05:00:47 [auto1.nl] INFO: Found listing with ID: WX34396
2026-03-28 05:00:47 [auto1.nl] INFO: Found listing with ID: WC04014
2026-03-28 05:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WC04014%27 HTTP/1.1" 200 None
2026-03-28 05:00:47 [auto1.nl] INFO: Scrape type for WC04014: 0
2026-03-28 05:00:47 [auto1.nl] INFO: Found listing with ID: PZ01481
2026-03-28 05:00:47 [auto1.nl] INFO: Found listing with ID: VF61988
2026-03-28 05:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VF61988%27 HTTP/1.1" 200 None
2026-03-28 05:00:47 [auto1.nl] INFO: Scrape type for VF61988: 0
2026-03-28 05:00:47 [auto1.nl] INFO: Found listing with ID: EK85406
2026-03-28 05:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:00:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EK85406%27 HTTP/1.1" 200 None
2026-03-28 05:00:47 [auto1.nl] INFO: Scrape type for EK85406: 0
2026-03-28 05:00:48 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:00:48 [auto1.nl] INFO: Channel: 24h | Page: 1 | totalHits: 917 | hits on page: 40
2026-03-28 05:00:48 [auto1.nl] INFO: Found listing with ID: JH98357
2026-03-28 05:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JH98357%27 HTTP/1.1" 200 None
2026-03-28 05:00:48 [auto1.nl] INFO: Scrape type for JH98357: 0
2026-03-28 05:00:48 [auto1.nl] INFO: Found listing with ID: XW85568
2026-03-28 05:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XW85568%27 HTTP/1.1" 200 None
2026-03-28 05:00:48 [auto1.nl] INFO: Scrape type for XW85568: 0
2026-03-28 05:00:48 [auto1.nl] INFO: Found listing with ID: ET91545
2026-03-28 05:00:48 [auto1.nl] INFO: Found listing with ID: TF89424
2026-03-28 05:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TF89424%27 HTTP/1.1" 200 None
2026-03-28 05:00:48 [auto1.nl] INFO: Scrape type for TF89424: 0
2026-03-28 05:00:48 [auto1.nl] INFO: Found listing with ID: VC45761
2026-03-28 05:00:48 [auto1.nl] INFO: Found listing with ID: CT54062
2026-03-28 05:00:48 [auto1.nl] INFO: Found listing with ID: AR13994
2026-03-28 05:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AR13994%27 HTTP/1.1" 200 None
2026-03-28 05:00:48 [auto1.nl] INFO: Scrape type for AR13994: 0
2026-03-28 05:00:48 [auto1.nl] INFO: Found listing with ID: CA41421
2026-03-28 05:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CA41421%27 HTTP/1.1" 200 None
2026-03-28 05:00:48 [auto1.nl] INFO: Scrape type for CA41421: 0
2026-03-28 05:00:48 [auto1.nl] INFO: Found listing with ID: EX94963
2026-03-28 05:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EX94963%27 HTTP/1.1" 200 None
2026-03-28 05:00:48 [auto1.nl] INFO: Scrape type for EX94963: 0
2026-03-28 05:00:48 [auto1.nl] INFO: Found listing with ID: ZA54727
2026-03-28 05:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZA54727%27 HTTP/1.1" 200 None
2026-03-28 05:00:48 [auto1.nl] INFO: Scrape type for ZA54727: 0
2026-03-28 05:00:48 [auto1.nl] INFO: Found listing with ID: BX02996
2026-03-28 05:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BX02996%27 HTTP/1.1" 200 None
2026-03-28 05:00:48 [auto1.nl] INFO: Scrape type for BX02996: 0
2026-03-28 05:00:48 [auto1.nl] INFO: Found listing with ID: RY27630
2026-03-28 05:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RY27630%27 HTTP/1.1" 200 None
2026-03-28 05:00:48 [auto1.nl] INFO: Scrape type for RY27630: 0
2026-03-28 05:00:48 [auto1.nl] INFO: Found listing with ID: RJ64387
2026-03-28 05:00:48 [auto1.nl] INFO: Found listing with ID: FE12544
2026-03-28 05:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FE12544%27 HTTP/1.1" 200 None
2026-03-28 05:00:48 [auto1.nl] INFO: Scrape type for FE12544: 0
2026-03-28 05:00:48 [auto1.nl] INFO: Found listing with ID: GL59810
2026-03-28 05:00:48 [auto1.nl] INFO: Found listing with ID: CG41463
2026-03-28 05:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CG41463%27 HTTP/1.1" 200 None
2026-03-28 05:00:48 [auto1.nl] INFO: Scrape type for CG41463: 0
2026-03-28 05:00:48 [auto1.nl] INFO: Found listing with ID: FV36091
2026-03-28 05:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FV36091%27 HTTP/1.1" 200 None
2026-03-28 05:00:48 [auto1.nl] INFO: Scrape type for FV36091: 0
2026-03-28 05:00:48 [auto1.nl] INFO: Found listing with ID: SJ21377
2026-03-28 05:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SJ21377%27 HTTP/1.1" 200 None
2026-03-28 05:00:48 [auto1.nl] INFO: Scrape type for SJ21377: 0
2026-03-28 05:00:48 [auto1.nl] INFO: Found listing with ID: PG19961
2026-03-28 05:00:48 [auto1.nl] INFO: Found listing with ID: YW05960
2026-03-28 05:00:48 [auto1.nl] INFO: Found listing with ID: MM65316
2026-03-28 05:00:48 [auto1.nl] INFO: Found listing with ID: DG42232
2026-03-28 05:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DG42232%27 HTTP/1.1" 200 None
2026-03-28 05:00:48 [auto1.nl] INFO: Scrape type for DG42232: 0
2026-03-28 05:00:48 [auto1.nl] INFO: Found listing with ID: VX32369
2026-03-28 05:00:48 [auto1.nl] INFO: Found listing with ID: NJ80961
2026-03-28 05:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NJ80961%27 HTTP/1.1" 200 None
2026-03-28 05:00:48 [auto1.nl] INFO: Scrape type for NJ80961: 0
2026-03-28 05:00:48 [auto1.nl] INFO: Found listing with ID: PL67988
2026-03-28 05:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PL67988%27 HTTP/1.1" 200 None
2026-03-28 05:00:48 [auto1.nl] INFO: Scrape type for PL67988: 0
2026-03-28 05:00:48 [auto1.nl] INFO: Found listing with ID: EU22503
2026-03-28 05:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EU22503%27 HTTP/1.1" 200 None
2026-03-28 05:00:48 [auto1.nl] INFO: Scrape type for EU22503: 0
2026-03-28 05:00:48 [auto1.nl] INFO: Found listing with ID: CS76145
2026-03-28 05:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CS76145%27 HTTP/1.1" 200 None
2026-03-28 05:00:48 [auto1.nl] INFO: Scrape type for CS76145: 0
2026-03-28 05:00:48 [auto1.nl] INFO: Found listing with ID: YP02517
2026-03-28 05:00:48 [auto1.nl] INFO: Found listing with ID: NR59954
2026-03-28 05:00:48 [auto1.nl] INFO: Found listing with ID: GA85229
2026-03-28 05:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GA85229%27 HTTP/1.1" 200 None
2026-03-28 05:00:48 [auto1.nl] INFO: Scrape type for GA85229: 0
2026-03-28 05:00:48 [auto1.nl] INFO: Found listing with ID: EH14183
2026-03-28 05:00:48 [auto1.nl] INFO: Found listing with ID: CK37627
2026-03-28 05:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CK37627%27 HTTP/1.1" 200 None
2026-03-28 05:00:48 [auto1.nl] INFO: Scrape type for CK37627: 0
2026-03-28 05:00:48 [auto1.nl] INFO: Found listing with ID: UE74675
2026-03-28 05:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UE74675%27 HTTP/1.1" 200 None
2026-03-28 05:00:48 [auto1.nl] INFO: Scrape type for UE74675: 0
2026-03-28 05:00:48 [auto1.nl] INFO: Found listing with ID: LA17019
2026-03-28 05:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LA17019%27 HTTP/1.1" 200 None
2026-03-28 05:00:48 [auto1.nl] INFO: Scrape type for LA17019: 0
2026-03-28 05:00:48 [auto1.nl] INFO: Found listing with ID: VD03329
2026-03-28 05:00:48 [auto1.nl] INFO: Found listing with ID: WX34396
2026-03-28 05:00:48 [auto1.nl] INFO: Found listing with ID: WC04014
2026-03-28 05:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WC04014%27 HTTP/1.1" 200 None
2026-03-28 05:00:48 [auto1.nl] INFO: Scrape type for WC04014: 0
2026-03-28 05:00:48 [auto1.nl] INFO: Found listing with ID: PZ01481
2026-03-28 05:00:48 [auto1.nl] INFO: Found listing with ID: VF61988
2026-03-28 05:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:00:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VF61988%27 HTTP/1.1" 200 None
2026-03-28 05:00:49 [auto1.nl] INFO: Scrape type for VF61988: 0
2026-03-28 05:00:49 [auto1.nl] INFO: Found listing with ID: EK85406
2026-03-28 05:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:00:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EK85406%27 HTTP/1.1" 200 None
2026-03-28 05:00:49 [auto1.nl] INFO: Scrape type for EK85406: 0
2026-03-28 05:00:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:00:50 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:00:50 [auto1.nl] INFO: Channel: 24h | Page: 2 | totalHits: 917 | hits on page: 40
2026-03-28 05:00:50 [auto1.nl] INFO: Found listing with ID: RF40574
2026-03-28 05:00:50 [auto1.nl] INFO: Found listing with ID: AA80905
2026-03-28 05:00:50 [auto1.nl] INFO: Found listing with ID: WF02577
2026-03-28 05:00:50 [auto1.nl] INFO: Found listing with ID: LF75031
2026-03-28 05:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LF75031%27 HTTP/1.1" 200 None
2026-03-28 05:00:50 [auto1.nl] INFO: Scrape type for LF75031: 0
2026-03-28 05:00:50 [auto1.nl] INFO: Found listing with ID: TU99712
2026-03-28 05:00:50 [auto1.nl] INFO: Found listing with ID: RA23366
2026-03-28 05:00:50 [auto1.nl] INFO: Found listing with ID: KV59291
2026-03-28 05:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KV59291%27 HTTP/1.1" 200 None
2026-03-28 05:00:50 [auto1.nl] INFO: Scrape type for KV59291: 0
2026-03-28 05:00:50 [auto1.nl] INFO: Found listing with ID: UB80121
2026-03-28 05:00:50 [auto1.nl] INFO: Found listing with ID: LG71332
2026-03-28 05:00:50 [auto1.nl] INFO: Found listing with ID: NZ11721
2026-03-28 05:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NZ11721%27 HTTP/1.1" 200 None
2026-03-28 05:00:50 [auto1.nl] INFO: Scrape type for NZ11721: 0
2026-03-28 05:00:50 [auto1.nl] INFO: Found listing with ID: JM47469
2026-03-28 05:00:50 [auto1.nl] INFO: Found listing with ID: BX66014
2026-03-28 05:00:50 [auto1.nl] INFO: Found listing with ID: ME20407
2026-03-28 05:00:50 [auto1.nl] INFO: Found listing with ID: SR40415
2026-03-28 05:00:50 [auto1.nl] INFO: Found listing with ID: MZ48021
2026-03-28 05:00:50 [auto1.nl] INFO: Found listing with ID: VH01672
2026-03-28 05:00:50 [auto1.nl] INFO: Found listing with ID: FH34143
2026-03-28 05:00:50 [auto1.nl] INFO: Found listing with ID: YP25238
2026-03-28 05:00:50 [auto1.nl] INFO: Found listing with ID: HS95271
2026-03-28 05:00:50 [auto1.nl] INFO: Found listing with ID: PJ78328
2026-03-28 05:00:50 [auto1.nl] INFO: Found listing with ID: YS44884
2026-03-28 05:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YS44884%27 HTTP/1.1" 200 None
2026-03-28 05:00:50 [auto1.nl] INFO: Scrape type for YS44884: 0
2026-03-28 05:00:50 [auto1.nl] INFO: Found listing with ID: MW65068
2026-03-28 05:00:50 [auto1.nl] INFO: Found listing with ID: KB97698
2026-03-28 05:00:50 [auto1.nl] INFO: Found listing with ID: UC91516
2026-03-28 05:00:50 [auto1.nl] INFO: Found listing with ID: JC34887
2026-03-28 05:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JC34887%27 HTTP/1.1" 200 None
2026-03-28 05:00:50 [auto1.nl] INFO: Scrape type for JC34887: 0
2026-03-28 05:00:50 [auto1.nl] INFO: Found listing with ID: LU39943
2026-03-28 05:00:50 [auto1.nl] INFO: Found listing with ID: UR86175
2026-03-28 05:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UR86175%27 HTTP/1.1" 200 None
2026-03-28 05:00:50 [auto1.nl] INFO: Scrape type for UR86175: 0
2026-03-28 05:00:50 [auto1.nl] INFO: Found listing with ID: ED59845
2026-03-28 05:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ED59845%27 HTTP/1.1" 200 None
2026-03-28 05:00:50 [auto1.nl] INFO: Scrape type for ED59845: 2
2026-03-28 05:00:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7ede0909-33d7-527f-94e0-7f03c07ac86f with identifier: ED59845
2026-03-28 05:00:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7ede0909-33d7-527f-94e0-7f03c07ac86f with scrape type 2
2026-03-28 05:00:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7ede0909-33d7-527f-94e0-7f03c07ac86f with scrape type 2
2026-03-28 05:00:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 7ede0909-33d7-527f-94e0-7f03c07ac86f, identifier: ED59845
2026-03-28 05:00:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 7ede0909-33d7-527f-94e0-7f03c07ac86f with identifier: ED59845
2026-03-28 05:00:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 05:00:50 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=gray HTTP/1.1" 200 None
2026-03-28 05:00:50 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 05:00:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 05:00:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 7ede0909-33d7-527f-94e0-7f03c07ac86f with identifier: ED59845
2026-03-28 05:00:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 7ede0909-33d7-527f-94e0-7f03c07ac86f with identifier: ED59845 to the API
2026-03-28 05:00:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:00:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:00:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:11:30Z',
 'fuel_type': 'petrol',
 'id': '7ede0909-33d7-527f-94e0-7f03c07ac86f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ED59845',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Octavia',
 'odometer': 161040,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-10-24',
 'seller_name': None,
 'title': 'Skoda Octavia 1.5 TSI ACT Ambition',
 'transmission': 'automatic',
 'trim': 'Ambition',
 'year': 2019}
2026-03-28 05:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ED59845%27 HTTP/1.1" 200 None
2026-03-28 05:00:51 [auto1.nl] INFO: Saving data for ED59845: {'auction_closing_time': 1774714290.0, 'created_time': 1774465361.732452, 'last_price_update_time': 1774674051.133617}
2026-03-28 05:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='ED59845') HTTP/1.1" 204 0
2026-03-28 05:00:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:00:51 [auto1.nl] INFO: Found listing with ID: CV76653
2026-03-28 05:00:51 [auto1.nl] INFO: Found listing with ID: SD39656
2026-03-28 05:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SD39656%27 HTTP/1.1" 200 None
2026-03-28 05:00:51 [auto1.nl] INFO: Scrape type for SD39656: 0
2026-03-28 05:00:51 [auto1.nl] INFO: Found listing with ID: DA17330
2026-03-28 05:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DA17330%27 HTTP/1.1" 200 None
2026-03-28 05:00:51 [auto1.nl] INFO: Scrape type for DA17330: 2
2026-03-28 05:00:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d345c5c7-8e63-554b-8c06-86e5b49fe53a with identifier: DA17330
2026-03-28 05:00:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d345c5c7-8e63-554b-8c06-86e5b49fe53a with scrape type 2
2026-03-28 05:00:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d345c5c7-8e63-554b-8c06-86e5b49fe53a with scrape type 2
2026-03-28 05:00:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: d345c5c7-8e63-554b-8c06-86e5b49fe53a, identifier: DA17330
2026-03-28 05:00:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: d345c5c7-8e63-554b-8c06-86e5b49fe53a with identifier: DA17330
2026-03-28 05:00:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: d345c5c7-8e63-554b-8c06-86e5b49fe53a with identifier: DA17330
2026-03-28 05:00:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: d345c5c7-8e63-554b-8c06-86e5b49fe53a with identifier: DA17330 to the API
2026-03-28 05:00:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:00:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:00:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 82,
 'expiration_date': '2026-03-28T16:29:53Z',
 'fuel_type': 'petrol',
 'id': 'd345c5c7-8e63-554b-8c06-86e5b49fe53a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DA17330',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '2008',
 'odometer': 16892,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-02-27',
 'seller_name': None,
 'title': 'Peugeot 2008 1.2 e-VTi Active',
 'transmission': 'automatic',
 'trim': 'Active',
 'year': 2017}
2026-03-28 05:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DA17330%27 HTTP/1.1" 200 None
2026-03-28 05:00:51 [auto1.nl] INFO: Saving data for DA17330: {'auction_closing_time': 1774715393.0, 'created_time': 1774465251.991908, 'last_price_update_time': 1774674051.734191}
2026-03-28 05:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='DA17330') HTTP/1.1" 204 0
2026-03-28 05:00:51 [auto1.nl] INFO: Found listing with ID: CZ60443
2026-03-28 05:00:51 [auto1.nl] INFO: Found listing with ID: AB54016
2026-03-28 05:00:51 [auto1.nl] INFO: Found listing with ID: FJ00169
2026-03-28 05:00:51 [auto1.nl] INFO: Found listing with ID: WT58034
2026-03-28 05:00:51 [auto1.nl] INFO: Found listing with ID: GA05511
2026-03-28 05:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GA05511%27 HTTP/1.1" 200 None
2026-03-28 05:00:51 [auto1.nl] INFO: Scrape type for GA05511: 0
2026-03-28 05:00:51 [auto1.nl] INFO: Found listing with ID: YM03723
2026-03-28 05:00:51 [auto1.nl] INFO: Found listing with ID: TR64287
2026-03-28 05:00:51 [auto1.nl] INFO: Found listing with ID: NR95179
2026-03-28 05:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:00:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NR95179%27 HTTP/1.1" 200 None
2026-03-28 05:00:51 [auto1.nl] INFO: Scrape type for NR95179: 2
2026-03-28 05:00:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e8ce33b9-179a-55c2-b445-fa3538e6dc64 with identifier: NR95179
2026-03-28 05:00:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e8ce33b9-179a-55c2-b445-fa3538e6dc64 with scrape type 2
2026-03-28 05:00:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e8ce33b9-179a-55c2-b445-fa3538e6dc64 with scrape type 2
2026-03-28 05:00:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: e8ce33b9-179a-55c2-b445-fa3538e6dc64, identifier: NR95179
2026-03-28 05:00:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: e8ce33b9-179a-55c2-b445-fa3538e6dc64 with identifier: NR95179
2026-03-28 05:00:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 05:00:52 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=black HTTP/1.1" 200 None
2026-03-28 05:00:52 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 05:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 05:00:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: e8ce33b9-179a-55c2-b445-fa3538e6dc64 with identifier: NR95179
2026-03-28 05:00:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: e8ce33b9-179a-55c2-b445-fa3538e6dc64 with identifier: NR95179 to the API
2026-03-28 05:00:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:00:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:00:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 155,
 'expiration_date': '2026-03-28T16:47:50Z',
 'fuel_type': 'petrol',
 'id': 'e8ce33b9-179a-55c2-b445-fa3538e6dc64',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NR95179',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '5008',
 'odometer': 66453,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-04-28',
 'seller_name': None,
 'title': 'Peugeot 5008 1.6 THP Premium',
 'transmission': 'automatic',
 'trim': 'Premium',
 'year': 2010}
2026-03-28 05:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NR95179%27 HTTP/1.1" 200 None
2026-03-28 05:00:52 [auto1.nl] INFO: Saving data for NR95179: {'auction_closing_time': 1774716470.0, 'created_time': 1773135022.096805, 'last_price_update_time': 1774674052.487835}
2026-03-28 05:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='NR95179') HTTP/1.1" 204 0
2026-03-28 05:00:52 [auto1.nl] INFO: Found listing with ID: WS89953
2026-03-28 05:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:00:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WS89953%27 HTTP/1.1" 200 None
2026-03-28 05:00:52 [auto1.nl] INFO: Scrape type for WS89953: 0
2026-03-28 05:00:53 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:00:53 [auto1.nl] INFO: Channel: 24h | Page: 3 | totalHits: 917 | hits on page: 40
2026-03-28 05:00:53 [auto1.nl] INFO: Found listing with ID: LE34975
2026-03-28 05:00:53 [auto1.nl] INFO: Found listing with ID: AA68968
2026-03-28 05:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AA68968%27 HTTP/1.1" 200 None
2026-03-28 05:00:53 [auto1.nl] INFO: Scrape type for AA68968: 0
2026-03-28 05:00:53 [auto1.nl] INFO: Found listing with ID: FK53895
2026-03-28 05:00:53 [auto1.nl] INFO: Found listing with ID: MU53685
2026-03-28 05:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MU53685%27 HTTP/1.1" 200 None
2026-03-28 05:00:53 [auto1.nl] INFO: Scrape type for MU53685: 0
2026-03-28 05:00:53 [auto1.nl] INFO: Found listing with ID: HK41309
2026-03-28 05:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HK41309%27 HTTP/1.1" 200 None
2026-03-28 05:00:53 [auto1.nl] INFO: Scrape type for HK41309: 0
2026-03-28 05:00:53 [auto1.nl] INFO: Found listing with ID: JX13279
2026-03-28 05:00:53 [auto1.nl] INFO: Found listing with ID: LL90951
2026-03-28 05:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LL90951%27 HTTP/1.1" 200 None
2026-03-28 05:00:53 [auto1.nl] INFO: Scrape type for LL90951: 0
2026-03-28 05:00:53 [auto1.nl] INFO: Found listing with ID: RY51498
2026-03-28 05:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:00:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RY51498%27 HTTP/1.1" 200 None
2026-03-28 05:00:53 [auto1.nl] INFO: Scrape type for RY51498: 0
2026-03-28 05:00:53 [auto1.nl] INFO: Found listing with ID: AY12537
2026-03-28 05:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AY12537%27 HTTP/1.1" 200 None
2026-03-28 05:00:54 [auto1.nl] INFO: Scrape type for AY12537: 2
2026-03-28 05:00:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a4a8008c-d2fe-584e-86bb-7cef9535dfd9 with identifier: AY12537
2026-03-28 05:00:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a4a8008c-d2fe-584e-86bb-7cef9535dfd9 with scrape type 2
2026-03-28 05:00:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a4a8008c-d2fe-584e-86bb-7cef9535dfd9 with scrape type 2
2026-03-28 05:00:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: a4a8008c-d2fe-584e-86bb-7cef9535dfd9, identifier: AY12537
2026-03-28 05:00:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: a4a8008c-d2fe-584e-86bb-7cef9535dfd9 with identifier: AY12537
2026-03-28 05:00:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 05:00:54 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=brown HTTP/1.1" 200 None
2026-03-28 05:00:54 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 05:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 05:00:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: a4a8008c-d2fe-584e-86bb-7cef9535dfd9 with identifier: AY12537
2026-03-28 05:00:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: a4a8008c-d2fe-584e-86bb-7cef9535dfd9 with identifier: AY12537 to the API
2026-03-28 05:00:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:00:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:00:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-28T16:20:09Z',
 'fuel_type': 'petrol',
 'id': 'a4a8008c-d2fe-584e-86bb-7cef9535dfd9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AY12537',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Captur',
 'odometer': 40505,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-05-13',
 'seller_name': None,
 'title': 'Renault Captur 0.9 Energy Life',
 'transmission': 'manual',
 'trim': 'Life',
 'year': 2016}
2026-03-28 05:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AY12537%27 HTTP/1.1" 200 None
2026-03-28 05:00:54 [auto1.nl] INFO: Saving data for AY12537: {'auction_closing_time': 1774714809.0, 'created_time': 1774465250.675106, 'last_price_update_time': 1774674054.65041}
2026-03-28 05:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='AY12537') HTTP/1.1" 204 0
2026-03-28 05:00:54 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:00:54 [auto1.nl] INFO: Found listing with ID: EB25456
2026-03-28 05:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EB25456%27 HTTP/1.1" 200 None
2026-03-28 05:00:54 [auto1.nl] INFO: Scrape type for EB25456: 0
2026-03-28 05:00:54 [auto1.nl] INFO: Found listing with ID: NT56594
2026-03-28 05:00:54 [auto1.nl] INFO: Found listing with ID: XG57923
2026-03-28 05:00:54 [auto1.nl] INFO: Found listing with ID: FU47491
2026-03-28 05:00:54 [auto1.nl] INFO: Found listing with ID: NL54745
2026-03-28 05:00:54 [auto1.nl] INFO: Found listing with ID: AS22669
2026-03-28 05:00:54 [auto1.nl] INFO: Found listing with ID: BM26306
2026-03-28 05:00:54 [auto1.nl] INFO: Found listing with ID: SA56403
2026-03-28 05:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SA56403%27 HTTP/1.1" 200 None
2026-03-28 05:00:54 [auto1.nl] INFO: Scrape type for SA56403: 0
2026-03-28 05:00:54 [auto1.nl] INFO: Found listing with ID: CP01462
2026-03-28 05:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CP01462%27 HTTP/1.1" 200 None
2026-03-28 05:00:54 [auto1.nl] INFO: Scrape type for CP01462: 0
2026-03-28 05:00:54 [auto1.nl] INFO: Found listing with ID: ZM76247
2026-03-28 05:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZM76247%27 HTTP/1.1" 200 None
2026-03-28 05:00:54 [auto1.nl] INFO: Scrape type for ZM76247: 0
2026-03-28 05:00:54 [auto1.nl] INFO: Found listing with ID: MM08239
2026-03-28 05:00:54 [auto1.nl] INFO: Found listing with ID: FT93592
2026-03-28 05:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FT93592%27 HTTP/1.1" 200 None
2026-03-28 05:00:54 [auto1.nl] INFO: Scrape type for FT93592: 0
2026-03-28 05:00:54 [auto1.nl] INFO: Found listing with ID: YF39374
2026-03-28 05:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YF39374%27 HTTP/1.1" 200 None
2026-03-28 05:00:54 [auto1.nl] INFO: Scrape type for YF39374: 0
2026-03-28 05:00:54 [auto1.nl] INFO: Found listing with ID: KB15106
2026-03-28 05:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KB15106%27 HTTP/1.1" 200 None
2026-03-28 05:00:54 [auto1.nl] INFO: Scrape type for KB15106: 0
2026-03-28 05:00:54 [auto1.nl] INFO: Found listing with ID: HS94001
2026-03-28 05:00:54 [auto1.nl] INFO: Found listing with ID: XG69964
2026-03-28 05:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XG69964%27 HTTP/1.1" 200 None
2026-03-28 05:00:54 [auto1.nl] INFO: Scrape type for XG69964: 0
2026-03-28 05:00:54 [auto1.nl] INFO: Found listing with ID: BL56682
2026-03-28 05:00:54 [auto1.nl] INFO: Found listing with ID: MB63862
2026-03-28 05:00:54 [auto1.nl] INFO: Found listing with ID: YU59495
2026-03-28 05:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:00:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YU59495%27 HTTP/1.1" 200 None
2026-03-28 05:00:54 [auto1.nl] INFO: Scrape type for YU59495: 2
2026-03-28 05:00:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dc3e50cc-8f25-5334-8622-762e02384d08 with identifier: YU59495
2026-03-28 05:00:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dc3e50cc-8f25-5334-8622-762e02384d08 with scrape type 2
2026-03-28 05:00:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dc3e50cc-8f25-5334-8622-762e02384d08 with scrape type 2
2026-03-28 05:00:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: dc3e50cc-8f25-5334-8622-762e02384d08, identifier: YU59495
2026-03-28 05:00:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: dc3e50cc-8f25-5334-8622-762e02384d08 with identifier: YU59495
2026-03-28 05:00:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 05:00:55 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=blue HTTP/1.1" 200 None
2026-03-28 05:00:55 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 05:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 05:00:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 05:00:55 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=electro HTTP/1.1" 200 None
2026-03-28 05:00:55 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 05:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 05:00:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: dc3e50cc-8f25-5334-8622-762e02384d08 with identifier: YU59495
2026-03-28 05:00:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: dc3e50cc-8f25-5334-8622-762e02384d08 with identifier: YU59495 to the API
2026-03-28 05:00:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:00:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:00:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-28T16:39:14Z',
 'fuel_type': 'electro',
 'id': 'dc3e50cc-8f25-5334-8622-762e02384d08',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YU59495',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'IONIQ',
 'odometer': 176630,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-08-12',
 'seller_name': None,
 'title': 'Hyundai IONIQ electric drive 88 kW Style Elektro',
 'transmission': 'automatic',
 'trim': 'Style Elektro',
 'year': 2018}
2026-03-28 05:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YU59495%27 HTTP/1.1" 200 None
2026-03-28 05:00:55 [auto1.nl] INFO: Saving data for YU59495: {'auction_closing_time': 1774715954.0, 'created_time': 1774551707.334864, 'last_price_update_time': 1774674055.556885}
2026-03-28 05:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='YU59495') HTTP/1.1" 204 0
2026-03-28 05:00:55 [auto1.nl] INFO: Found listing with ID: CW75343
2026-03-28 05:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CW75343%27 HTTP/1.1" 200 None
2026-03-28 05:00:55 [auto1.nl] INFO: Scrape type for CW75343: 0
2026-03-28 05:00:55 [auto1.nl] INFO: Found listing with ID: EA94129
2026-03-28 05:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EA94129%27 HTTP/1.1" 200 None
2026-03-28 05:00:55 [auto1.nl] INFO: Scrape type for EA94129: 0
2026-03-28 05:00:55 [auto1.nl] INFO: Found listing with ID: SE84312
2026-03-28 05:00:55 [auto1.nl] INFO: Found listing with ID: JR01730
2026-03-28 05:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JR01730%27 HTTP/1.1" 200 None
2026-03-28 05:00:55 [auto1.nl] INFO: Scrape type for JR01730: 0
2026-03-28 05:00:55 [auto1.nl] INFO: Found listing with ID: PE73396
2026-03-28 05:00:55 [auto1.nl] INFO: Found listing with ID: CY41827
2026-03-28 05:00:55 [auto1.nl] INFO: Found listing with ID: JJ61661
2026-03-28 05:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JJ61661%27 HTTP/1.1" 200 None
2026-03-28 05:00:55 [auto1.nl] INFO: Scrape type for JJ61661: 0
2026-03-28 05:00:55 [auto1.nl] INFO: Found listing with ID: YK25571
2026-03-28 05:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:00:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YK25571%27 HTTP/1.1" 200 None
2026-03-28 05:00:55 [auto1.nl] INFO: Scrape type for YK25571: 0
2026-03-28 05:00:55 [auto1.nl] INFO: Found listing with ID: ZG22704
2026-03-28 05:00:55 [auto1.nl] INFO: Found listing with ID: PS09006
2026-03-28 05:00:55 [auto1.nl] INFO: Found listing with ID: KB59261
2026-03-28 05:00:55 [auto1.nl] INFO: Found listing with ID: PF97973
2026-03-28 05:00:56 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:00:56 [auto1.nl] INFO: Channel: 24h | Page: 4 | totalHits: 917 | hits on page: 40
2026-03-28 05:00:56 [auto1.nl] INFO: Found listing with ID: NU05681
2026-03-28 05:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NU05681%27 HTTP/1.1" 200 None
2026-03-28 05:00:56 [auto1.nl] INFO: Scrape type for NU05681: 0
2026-03-28 05:00:56 [auto1.nl] INFO: Found listing with ID: NR57871
2026-03-28 05:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NR57871%27 HTTP/1.1" 200 None
2026-03-28 05:00:56 [auto1.nl] INFO: Scrape type for NR57871: 0
2026-03-28 05:00:56 [auto1.nl] INFO: Found listing with ID: CH03360
2026-03-28 05:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:00:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CH03360%27 HTTP/1.1" 200 None
2026-03-28 05:00:56 [auto1.nl] INFO: Scrape type for CH03360: 2
2026-03-28 05:00:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 88f7cf2e-c647-5eff-b762-64166e8e36e4 with identifier: CH03360
2026-03-28 05:00:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 88f7cf2e-c647-5eff-b762-64166e8e36e4 with scrape type 2
2026-03-28 05:00:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 88f7cf2e-c647-5eff-b762-64166e8e36e4 with scrape type 2
2026-03-28 05:00:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 88f7cf2e-c647-5eff-b762-64166e8e36e4, identifier: CH03360
2026-03-28 05:00:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 88f7cf2e-c647-5eff-b762-64166e8e36e4 with identifier: CH03360
2026-03-28 05:00:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 05:00:57 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=white HTTP/1.1" 200 None
2026-03-28 05:00:57 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 05:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 05:00:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 88f7cf2e-c647-5eff-b762-64166e8e36e4 with identifier: CH03360
2026-03-28 05:00:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 88f7cf2e-c647-5eff-b762-64166e8e36e4 with identifier: CH03360 to the API
2026-03-28 05:00:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:00:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:00:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-28T16:24:38Z',
 'fuel_type': 'petrol',
 'id': '88f7cf2e-c647-5eff-b762-64166e8e36e4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CH03360',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A5 Sportback',
 'odometer': 157384,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-03-30',
 'seller_name': None,
 'title': 'Audi A5 Sportback 2.0 TFSI',
 'transmission': 'automatic',
 'trim': '',
 'year': 2020}
2026-03-28 05:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CH03360%27 HTTP/1.1" 200 None
2026-03-28 05:00:57 [auto1.nl] INFO: Saving data for CH03360: {'auction_closing_time': 1774715078.0, 'created_time': 1774465381.62117, 'last_price_update_time': 1774674057.419077}
2026-03-28 05:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='CH03360') HTTP/1.1" 204 0
2026-03-28 05:00:57 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:00:57 [auto1.nl] INFO: Found listing with ID: KZ79748
2026-03-28 05:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KZ79748%27 HTTP/1.1" 200 None
2026-03-28 05:00:57 [auto1.nl] INFO: Scrape type for KZ79748: 0
2026-03-28 05:00:57 [auto1.nl] INFO: Found listing with ID: ZR90330
2026-03-28 05:00:57 [auto1.nl] INFO: Found listing with ID: XY38299
2026-03-28 05:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XY38299%27 HTTP/1.1" 200 None
2026-03-28 05:00:57 [auto1.nl] INFO: Scrape type for XY38299: 2
2026-03-28 05:00:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a3e66255-963b-53f4-a2ba-0273deeceab9 with identifier: XY38299
2026-03-28 05:00:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a3e66255-963b-53f4-a2ba-0273deeceab9 with scrape type 2
2026-03-28 05:00:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a3e66255-963b-53f4-a2ba-0273deeceab9 with scrape type 2
2026-03-28 05:00:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: a3e66255-963b-53f4-a2ba-0273deeceab9, identifier: XY38299
2026-03-28 05:00:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: a3e66255-963b-53f4-a2ba-0273deeceab9 with identifier: XY38299
2026-03-28 05:00:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: a3e66255-963b-53f4-a2ba-0273deeceab9 with identifier: XY38299
2026-03-28 05:00:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: a3e66255-963b-53f4-a2ba-0273deeceab9 with identifier: XY38299 to the API
2026-03-28 05:00:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:00:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:00:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 355,
 'expiration_date': '2026-03-28T16:28:22Z',
 'fuel_type': 'petrol',
 'id': 'a3e66255-963b-53f4-a2ba-0273deeceab9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XY38299',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'S5 Sportback',
 'odometer': 201671,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-07-27',
 'seller_name': None,
 'title': 'Audi S5 Sportback 3.0 V6 TFSI quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2017}
2026-03-28 05:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:00:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XY38299%27 HTTP/1.1" 200 None
2026-03-28 05:00:57 [auto1.nl] INFO: Saving data for XY38299: {'auction_closing_time': 1774715302.0, 'created_time': 1774119693.080719, 'last_price_update_time': 1774674057.991478}
2026-03-28 05:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='XY38299') HTTP/1.1" 204 0
2026-03-28 05:00:58 [auto1.nl] INFO: Found listing with ID: TD45630
2026-03-28 05:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TD45630%27 HTTP/1.1" 200 None
2026-03-28 05:00:58 [auto1.nl] INFO: Scrape type for TD45630: 2
2026-03-28 05:00:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 838118c5-4729-56e0-a226-1c8adc8e06eb with identifier: TD45630
2026-03-28 05:00:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 838118c5-4729-56e0-a226-1c8adc8e06eb with scrape type 2
2026-03-28 05:00:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 838118c5-4729-56e0-a226-1c8adc8e06eb with scrape type 2
2026-03-28 05:00:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 838118c5-4729-56e0-a226-1c8adc8e06eb, identifier: TD45630
2026-03-28 05:00:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 838118c5-4729-56e0-a226-1c8adc8e06eb with identifier: TD45630
2026-03-28 05:00:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 838118c5-4729-56e0-a226-1c8adc8e06eb with identifier: TD45630
2026-03-28 05:00:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 838118c5-4729-56e0-a226-1c8adc8e06eb with identifier: TD45630 to the API
2026-03-28 05:00:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:00:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:00:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-28T16:33:00Z',
 'fuel_type': 'petrol',
 'id': '838118c5-4729-56e0-a226-1c8adc8e06eb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TD45630',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '308',
 'odometer': 89170,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-03-30',
 'seller_name': None,
 'title': 'Peugeot 308 1.2 e-THP Allure',
 'transmission': 'manual',
 'trim': 'Allure',
 'year': 2017}
2026-03-28 05:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TD45630%27 HTTP/1.1" 200 None
2026-03-28 05:00:58 [auto1.nl] INFO: Saving data for TD45630: {'auction_closing_time': 1774715580.0, 'created_time': 1774465420.394091, 'last_price_update_time': 1774674058.521269}
2026-03-28 05:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='TD45630') HTTP/1.1" 204 0
2026-03-28 05:00:58 [auto1.nl] INFO: Found listing with ID: GS00430
2026-03-28 05:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GS00430%27 HTTP/1.1" 200 None
2026-03-28 05:00:58 [auto1.nl] INFO: Scrape type for GS00430: 2
2026-03-28 05:00:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 88ab0552-9495-5e71-b95f-805101b40200 with identifier: GS00430
2026-03-28 05:00:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 88ab0552-9495-5e71-b95f-805101b40200 with scrape type 2
2026-03-28 05:00:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 88ab0552-9495-5e71-b95f-805101b40200 with scrape type 2
2026-03-28 05:00:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 88ab0552-9495-5e71-b95f-805101b40200, identifier: GS00430
2026-03-28 05:00:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 88ab0552-9495-5e71-b95f-805101b40200 with identifier: GS00430
2026-03-28 05:00:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 88ab0552-9495-5e71-b95f-805101b40200 with identifier: GS00430
2026-03-28 05:00:58 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 88ab0552-9495-5e71-b95f-805101b40200 with identifier: GS00430 to the API
2026-03-28 05:00:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:00:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:00:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 180,
 'expiration_date': '2026-03-28T16:22:04Z',
 'fuel_type': 'petrol',
 'id': '88ab0552-9495-5e71-b95f-805101b40200',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GS00430',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Superb',
 'odometer': 148728,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-11-28',
 'seller_name': None,
 'title': 'Skoda Superb 1.8 TSI Style',
 'transmission': 'automatic',
 'trim': 'Style',
 'year': 2016}
2026-03-28 05:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:00:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GS00430%27 HTTP/1.1" 200 None
2026-03-28 05:00:58 [auto1.nl] INFO: Saving data for GS00430: {'auction_closing_time': 1774714924.0, 'created_time': 1774551753.594734, 'last_price_update_time': 1774674058.996325}
2026-03-28 05:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='GS00430') HTTP/1.1" 204 0
2026-03-28 05:00:59 [auto1.nl] INFO: Found listing with ID: VS32339
2026-03-28 05:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VS32339%27 HTTP/1.1" 200 None
2026-03-28 05:00:59 [auto1.nl] INFO: Scrape type for VS32339: 0
2026-03-28 05:00:59 [auto1.nl] INFO: Found listing with ID: MD48743
2026-03-28 05:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MD48743%27 HTTP/1.1" 200 None
2026-03-28 05:00:59 [auto1.nl] INFO: Scrape type for MD48743: 2
2026-03-28 05:00:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c02319c7-2ebf-5420-b7a4-cd9ece6d95de with identifier: MD48743
2026-03-28 05:00:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c02319c7-2ebf-5420-b7a4-cd9ece6d95de with scrape type 2
2026-03-28 05:00:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c02319c7-2ebf-5420-b7a4-cd9ece6d95de with scrape type 2
2026-03-28 05:00:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: c02319c7-2ebf-5420-b7a4-cd9ece6d95de, identifier: MD48743
2026-03-28 05:00:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: c02319c7-2ebf-5420-b7a4-cd9ece6d95de with identifier: MD48743
2026-03-28 05:00:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 05:00:59 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=hybrid HTTP/1.1" 200 None
2026-03-28 05:00:59 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 05:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 05:00:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: c02319c7-2ebf-5420-b7a4-cd9ece6d95de with identifier: MD48743
2026-03-28 05:00:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: c02319c7-2ebf-5420-b7a4-cd9ece6d95de with identifier: MD48743 to the API
2026-03-28 05:00:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:00:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:00:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 204,
 'expiration_date': '2026-03-28T16:42:28Z',
 'fuel_type': 'hybrid',
 'id': 'c02319c7-2ebf-5420-b7a4-cd9ece6d95de',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MD48743',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 198005,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-12-31',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 1.4 GTE',
 'transmission': 'automatic',
 'trim': '',
 'year': 2014}
2026-03-28 05:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MD48743%27 HTTP/1.1" 200 None
2026-03-28 05:00:59 [auto1.nl] INFO: Saving data for MD48743: {'auction_closing_time': 1774716148.0, 'created_time': 1774551763.808433, 'last_price_update_time': 1774674059.661529}
2026-03-28 05:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='MD48743') HTTP/1.1" 204 0
2026-03-28 05:00:59 [auto1.nl] INFO: Found listing with ID: YW81523
2026-03-28 05:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YW81523%27 HTTP/1.1" 200 None
2026-03-28 05:00:59 [auto1.nl] INFO: Scrape type for YW81523: 0
2026-03-28 05:00:59 [auto1.nl] INFO: Found listing with ID: YG43162
2026-03-28 05:00:59 [auto1.nl] INFO: Found listing with ID: FH26666
2026-03-28 05:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FH26666%27 HTTP/1.1" 200 None
2026-03-28 05:00:59 [auto1.nl] INFO: Scrape type for FH26666: 0
2026-03-28 05:00:59 [auto1.nl] INFO: Found listing with ID: MY95801
2026-03-28 05:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MY95801%27 HTTP/1.1" 200 None
2026-03-28 05:00:59 [auto1.nl] INFO: Scrape type for MY95801: 0
2026-03-28 05:00:59 [auto1.nl] INFO: Found listing with ID: ZT03654
2026-03-28 05:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZT03654%27 HTTP/1.1" 200 None
2026-03-28 05:00:59 [auto1.nl] INFO: Scrape type for ZT03654: 0
2026-03-28 05:00:59 [auto1.nl] INFO: Found listing with ID: EZ41839
2026-03-28 05:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EZ41839%27 HTTP/1.1" 200 None
2026-03-28 05:00:59 [auto1.nl] INFO: Scrape type for EZ41839: 0
2026-03-28 05:00:59 [auto1.nl] INFO: Found listing with ID: GT38970
2026-03-28 05:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:00:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GT38970%27 HTTP/1.1" 200 None
2026-03-28 05:00:59 [auto1.nl] INFO: Scrape type for GT38970: 2
2026-03-28 05:00:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2866670f-8eac-5a83-9701-ae66cc90d68f with identifier: GT38970
2026-03-28 05:00:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2866670f-8eac-5a83-9701-ae66cc90d68f with scrape type 2
2026-03-28 05:00:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2866670f-8eac-5a83-9701-ae66cc90d68f with scrape type 2
2026-03-28 05:00:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 2866670f-8eac-5a83-9701-ae66cc90d68f, identifier: GT38970
2026-03-28 05:00:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 2866670f-8eac-5a83-9701-ae66cc90d68f with identifier: GT38970
2026-03-28 05:00:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 2866670f-8eac-5a83-9701-ae66cc90d68f with identifier: GT38970
2026-03-28 05:01:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 2866670f-8eac-5a83-9701-ae66cc90d68f with identifier: GT38970 to the API
2026-03-28 05:01:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:01:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:01:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-28T16:46:27Z',
 'fuel_type': 'petrol',
 'id': '2866670f-8eac-5a83-9701-ae66cc90d68f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GT38970',
 'listing': 'auction',
 'make': 'Fiat',
 'model': '500',
 'odometer': 230120,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-03-22',
 'seller_name': None,
 'title': 'Fiat 500 1.2 Pop',
 'transmission': 'manual',
 'trim': 'Pop',
 'year': 2008}
2026-03-28 05:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GT38970%27 HTTP/1.1" 200 None
2026-03-28 05:01:00 [auto1.nl] INFO: Saving data for GT38970: {'auction_closing_time': 1774716387.0, 'created_time': 1774465317.467331, 'last_price_update_time': 1774674060.288751}
2026-03-28 05:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='GT38970') HTTP/1.1" 204 0
2026-03-28 05:01:00 [auto1.nl] INFO: Found listing with ID: EN44222
2026-03-28 05:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EN44222%27 HTTP/1.1" 200 None
2026-03-28 05:01:00 [auto1.nl] INFO: Scrape type for EN44222: 2
2026-03-28 05:01:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c5274c10-ce3f-5dfb-99be-7ac258ac4ebd with identifier: EN44222
2026-03-28 05:01:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c5274c10-ce3f-5dfb-99be-7ac258ac4ebd with scrape type 2
2026-03-28 05:01:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c5274c10-ce3f-5dfb-99be-7ac258ac4ebd with scrape type 2
2026-03-28 05:01:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: c5274c10-ce3f-5dfb-99be-7ac258ac4ebd, identifier: EN44222
2026-03-28 05:01:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: c5274c10-ce3f-5dfb-99be-7ac258ac4ebd with identifier: EN44222
2026-03-28 05:01:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: c5274c10-ce3f-5dfb-99be-7ac258ac4ebd with identifier: EN44222
2026-03-28 05:01:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: c5274c10-ce3f-5dfb-99be-7ac258ac4ebd with identifier: EN44222 to the API
2026-03-28 05:01:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:01:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:01:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 305,
 'expiration_date': '2026-03-28T16:20:15Z',
 'fuel_type': 'petrol',
 'id': 'c5274c10-ce3f-5dfb-99be-7ac258ac4ebd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EN44222',
 'listing': 'auction',
 'make': 'BMW',
 'model': '5er',
 'odometer': 302205,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-09-19',
 'seller_name': None,
 'title': 'BMW 5er 535i',
 'transmission': 'automatic',
 'trim': '',
 'year': 2010}
2026-03-28 05:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EN44222%27 HTTP/1.1" 200 None
2026-03-28 05:01:00 [auto1.nl] INFO: Saving data for EN44222: {'auction_closing_time': 1774714815.0, 'created_time': 1774465303.361222, 'last_price_update_time': 1774674060.866314}
2026-03-28 05:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='EN44222') HTTP/1.1" 204 0
2026-03-28 05:01:00 [auto1.nl] INFO: Found listing with ID: MY36712
2026-03-28 05:01:00 [auto1.nl] INFO: Found listing with ID: DT43342
2026-03-28 05:01:00 [auto1.nl] INFO: Found listing with ID: XW63639
2026-03-28 05:01:00 [auto1.nl] INFO: Found listing with ID: DV35318
2026-03-28 05:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DV35318%27 HTTP/1.1" 200 None
2026-03-28 05:01:00 [auto1.nl] INFO: Scrape type for DV35318: 0
2026-03-28 05:01:00 [auto1.nl] INFO: Found listing with ID: PB89826
2026-03-28 05:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PB89826%27 HTTP/1.1" 200 None
2026-03-28 05:01:00 [auto1.nl] INFO: Scrape type for PB89826: 0
2026-03-28 05:01:00 [auto1.nl] INFO: Found listing with ID: KR09014
2026-03-28 05:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KR09014%27 HTTP/1.1" 200 None
2026-03-28 05:01:00 [auto1.nl] INFO: Scrape type for KR09014: 2
2026-03-28 05:01:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 496b6fb2-dbcb-5530-b560-fe99bb71c71f with identifier: KR09014
2026-03-28 05:01:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 496b6fb2-dbcb-5530-b560-fe99bb71c71f with scrape type 2
2026-03-28 05:01:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 496b6fb2-dbcb-5530-b560-fe99bb71c71f with scrape type 2
2026-03-28 05:01:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 496b6fb2-dbcb-5530-b560-fe99bb71c71f, identifier: KR09014
2026-03-28 05:01:01 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:01:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 496b6fb2-dbcb-5530-b560-fe99bb71c71f with identifier: KR09014
2026-03-28 05:01:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 496b6fb2-dbcb-5530-b560-fe99bb71c71f with identifier: KR09014
2026-03-28 05:01:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 496b6fb2-dbcb-5530-b560-fe99bb71c71f with identifier: KR09014 to the API
2026-03-28 05:01:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:01:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:01:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 286,
 'expiration_date': '2026-03-28T16:52:07Z',
 'fuel_type': 'electro',
 'id': '496b6fb2-dbcb-5530-b560-fe99bb71c71f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KR09014',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'iX3',
 'odometer': 124178,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-03-25',
 'seller_name': None,
 'title': 'BMW iX3 electric drive 210 kW Impressive',
 'transmission': 'automatic',
 'trim': 'Impressive',
 'year': 2021}
2026-03-28 05:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KR09014%27 HTTP/1.1" 200 None
2026-03-28 05:01:01 [auto1.nl] INFO: Saving data for KR09014: {'auction_closing_time': 1774716727.0, 'created_time': 1774551741.070013, 'last_price_update_time': 1774674061.362922}
2026-03-28 05:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='KR09014') HTTP/1.1" 204 0
2026-03-28 05:01:01 [auto1.nl] INFO: Found listing with ID: BZ17478
2026-03-28 05:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BZ17478%27 HTTP/1.1" 200 None
2026-03-28 05:01:01 [auto1.nl] INFO: Scrape type for BZ17478: 2
2026-03-28 05:01:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1d0135fd-690a-52e8-bc96-9ba7cdc200b4 with identifier: BZ17478
2026-03-28 05:01:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1d0135fd-690a-52e8-bc96-9ba7cdc200b4 with scrape type 2
2026-03-28 05:01:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1d0135fd-690a-52e8-bc96-9ba7cdc200b4 with scrape type 2
2026-03-28 05:01:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 1d0135fd-690a-52e8-bc96-9ba7cdc200b4, identifier: BZ17478
2026-03-28 05:01:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 1d0135fd-690a-52e8-bc96-9ba7cdc200b4 with identifier: BZ17478
2026-03-28 05:01:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 05:01:01 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=diesel HTTP/1.1" 200 None
2026-03-28 05:01:01 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 05:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 05:01:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 1d0135fd-690a-52e8-bc96-9ba7cdc200b4 with identifier: BZ17478
2026-03-28 05:01:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 1d0135fd-690a-52e8-bc96-9ba7cdc200b4 with identifier: BZ17478 to the API
2026-03-28 05:01:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:01:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:01:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 205,
 'expiration_date': '2026-03-28T16:44:34Z',
 'fuel_type': 'diesel',
 'id': '1d0135fd-690a-52e8-bc96-9ba7cdc200b4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BZ17478',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A4',
 'odometer': 270998,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2005-10-06',
 'seller_name': None,
 'title': 'Audi A4 3.0 V6 TDI quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2005}
2026-03-28 05:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BZ17478%27 HTTP/1.1" 200 None
2026-03-28 05:01:01 [auto1.nl] INFO: Saving data for BZ17478: {'auction_closing_time': 1774716274.0, 'created_time': 1774353819.482496, 'last_price_update_time': 1774674061.958529}
2026-03-28 05:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='BZ17478') HTTP/1.1" 204 0
2026-03-28 05:01:01 [auto1.nl] INFO: Found listing with ID: SX81397
2026-03-28 05:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SX81397%27 HTTP/1.1" 200 None
2026-03-28 05:01:01 [auto1.nl] INFO: Scrape type for SX81397: 0
2026-03-28 05:01:01 [auto1.nl] INFO: Found listing with ID: MK25507
2026-03-28 05:01:01 [auto1.nl] INFO: Found listing with ID: FA42645
2026-03-28 05:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FA42645%27 HTTP/1.1" 200 None
2026-03-28 05:01:02 [auto1.nl] INFO: Scrape type for FA42645: 2
2026-03-28 05:01:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 67079370-6b03-58f9-94ad-5aac8bb72660 with identifier: FA42645
2026-03-28 05:01:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 67079370-6b03-58f9-94ad-5aac8bb72660 with scrape type 2
2026-03-28 05:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 67079370-6b03-58f9-94ad-5aac8bb72660 with scrape type 2
2026-03-28 05:01:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 67079370-6b03-58f9-94ad-5aac8bb72660, identifier: FA42645
2026-03-28 05:01:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 67079370-6b03-58f9-94ad-5aac8bb72660 with identifier: FA42645
2026-03-28 05:01:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 67079370-6b03-58f9-94ad-5aac8bb72660 with identifier: FA42645
2026-03-28 05:01:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 67079370-6b03-58f9-94ad-5aac8bb72660 with identifier: FA42645 to the API
2026-03-28 05:01:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:01:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:01:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 68,
 'expiration_date': '2026-03-28T16:31:29Z',
 'fuel_type': 'petrol',
 'id': '67079370-6b03-58f9-94ad-5aac8bb72660',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FA42645',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '107',
 'odometer': 94829,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-08-11',
 'seller_name': None,
 'title': 'Peugeot 107 1.0 Filou',
 'transmission': 'manual',
 'trim': 'Filou',
 'year': 2011}
2026-03-28 05:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FA42645%27 HTTP/1.1" 200 None
2026-03-28 05:01:02 [auto1.nl] INFO: Saving data for FA42645: {'auction_closing_time': 1774715489.0, 'created_time': 1773342427.316309, 'last_price_update_time': 1774674062.496811}
2026-03-28 05:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='FA42645') HTTP/1.1" 204 0
2026-03-28 05:01:02 [auto1.nl] INFO: Channel: 24h | Page: 5 | totalHits: 917 | hits on page: 40
2026-03-28 05:01:02 [auto1.nl] INFO: Found listing with ID: GJ53353
2026-03-28 05:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GJ53353%27 HTTP/1.1" 200 None
2026-03-28 05:01:02 [auto1.nl] INFO: Scrape type for GJ53353: 2
2026-03-28 05:01:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c8772d51-4e1f-5f54-b828-fe3744173f8f with identifier: GJ53353
2026-03-28 05:01:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c8772d51-4e1f-5f54-b828-fe3744173f8f with scrape type 2
2026-03-28 05:01:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c8772d51-4e1f-5f54-b828-fe3744173f8f with scrape type 2
2026-03-28 05:01:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: c8772d51-4e1f-5f54-b828-fe3744173f8f, identifier: GJ53353
2026-03-28 05:01:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: c8772d51-4e1f-5f54-b828-fe3744173f8f with identifier: GJ53353
2026-03-28 05:01:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: c8772d51-4e1f-5f54-b828-fe3744173f8f with identifier: GJ53353
2026-03-28 05:01:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: c8772d51-4e1f-5f54-b828-fe3744173f8f with identifier: GJ53353 to the API
2026-03-28 05:01:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:01:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:01:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:19:27Z',
 'fuel_type': 'petrol',
 'id': 'c8772d51-4e1f-5f54-b828-fe3744173f8f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GJ53353',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Kodiaq',
 'odometer': 182650,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-01-02',
 'seller_name': None,
 'title': 'Skoda Kodiaq 1.5 TSI ACT Style',
 'transmission': 'automatic',
 'trim': 'Style',
 'year': 2019}
2026-03-28 05:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GJ53353%27 HTTP/1.1" 200 None
2026-03-28 05:01:03 [auto1.nl] INFO: Saving data for GJ53353: {'auction_closing_time': 1774714767.0, 'created_time': 1773836980.214382, 'last_price_update_time': 1774674063.125379}
2026-03-28 05:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='GJ53353') HTTP/1.1" 204 0
2026-03-28 05:01:03 [auto1.nl] INFO: Found listing with ID: RF14080
2026-03-28 05:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RF14080%27 HTTP/1.1" 200 None
2026-03-28 05:01:03 [auto1.nl] INFO: Scrape type for RF14080: 0
2026-03-28 05:01:03 [auto1.nl] INFO: Found listing with ID: MC36011
2026-03-28 05:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MC36011%27 HTTP/1.1" 200 None
2026-03-28 05:01:03 [auto1.nl] INFO: Scrape type for MC36011: 0
2026-03-28 05:01:03 [auto1.nl] INFO: Found listing with ID: WR79727
2026-03-28 05:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WR79727%27 HTTP/1.1" 200 None
2026-03-28 05:01:03 [auto1.nl] INFO: Scrape type for WR79727: 0
2026-03-28 05:01:03 [auto1.nl] INFO: Found listing with ID: DS36560
2026-03-28 05:01:03 [auto1.nl] INFO: Found listing with ID: CT33504
2026-03-28 05:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CT33504%27 HTTP/1.1" 200 None
2026-03-28 05:01:03 [auto1.nl] INFO: Scrape type for CT33504: 0
2026-03-28 05:01:03 [auto1.nl] INFO: Found listing with ID: SM80467
2026-03-28 05:01:03 [auto1.nl] INFO: Found listing with ID: MP54654
2026-03-28 05:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MP54654%27 HTTP/1.1" 200 None
2026-03-28 05:01:03 [auto1.nl] INFO: Scrape type for MP54654: 0
2026-03-28 05:01:03 [auto1.nl] INFO: Found listing with ID: JK36770
2026-03-28 05:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JK36770%27 HTTP/1.1" 200 None
2026-03-28 05:01:03 [auto1.nl] INFO: Scrape type for JK36770: 0
2026-03-28 05:01:03 [auto1.nl] INFO: Found listing with ID: EW85240
2026-03-28 05:01:03 [auto1.nl] INFO: Found listing with ID: GY89787
2026-03-28 05:01:03 [auto1.nl] INFO: Found listing with ID: EX12849
2026-03-28 05:01:03 [auto1.nl] INFO: Found listing with ID: CH10226
2026-03-28 05:01:03 [auto1.nl] INFO: Found listing with ID: VL07732
2026-03-28 05:01:03 [auto1.nl] INFO: Found listing with ID: PG05474
2026-03-28 05:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PG05474%27 HTTP/1.1" 200 None
2026-03-28 05:01:03 [auto1.nl] INFO: Scrape type for PG05474: 0
2026-03-28 05:01:03 [auto1.nl] INFO: Found listing with ID: ZR54060
2026-03-28 05:01:03 [auto1.nl] INFO: Found listing with ID: ZY63395
2026-03-28 05:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZY63395%27 HTTP/1.1" 200 None
2026-03-28 05:01:03 [auto1.nl] INFO: Scrape type for ZY63395: 0
2026-03-28 05:01:03 [auto1.nl] INFO: Found listing with ID: TH30413
2026-03-28 05:01:03 [auto1.nl] INFO: Found listing with ID: VJ06664
2026-03-28 05:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VJ06664%27 HTTP/1.1" 200 None
2026-03-28 05:01:03 [auto1.nl] INFO: Scrape type for VJ06664: 2
2026-03-28 05:01:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 56b92ad5-3716-5892-9868-65c8b7f4ef54 with identifier: VJ06664
2026-03-28 05:01:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 56b92ad5-3716-5892-9868-65c8b7f4ef54 with scrape type 2
2026-03-28 05:01:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 56b92ad5-3716-5892-9868-65c8b7f4ef54 with scrape type 2
2026-03-28 05:01:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 56b92ad5-3716-5892-9868-65c8b7f4ef54, identifier: VJ06664
2026-03-28 05:01:03 [auto1.nl] INFO: Found listing with ID: ZZ83139
2026-03-28 05:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZZ83139%27 HTTP/1.1" 200 None
2026-03-28 05:01:03 [auto1.nl] INFO: Scrape type for ZZ83139: 2
2026-03-28 05:01:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b9584b2f-bd34-5fbe-a86c-658e842b7998 with identifier: ZZ83139
2026-03-28 05:01:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b9584b2f-bd34-5fbe-a86c-658e842b7998 with scrape type 2
2026-03-28 05:01:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b9584b2f-bd34-5fbe-a86c-658e842b7998 with scrape type 2
2026-03-28 05:01:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: b9584b2f-bd34-5fbe-a86c-658e842b7998, identifier: ZZ83139
2026-03-28 05:01:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 56b92ad5-3716-5892-9868-65c8b7f4ef54 with identifier: VJ06664
2026-03-28 05:01:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 56b92ad5-3716-5892-9868-65c8b7f4ef54 with identifier: VJ06664
2026-03-28 05:01:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 56b92ad5-3716-5892-9868-65c8b7f4ef54 with identifier: VJ06664 to the API
2026-03-28 05:01:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:01:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:01:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-28T16:51:26Z',
 'fuel_type': 'petrol',
 'id': '56b92ad5-3716-5892-9868-65c8b7f4ef54',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VJ06664',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Leon',
 'odometer': 205142,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-10-13',
 'seller_name': None,
 'title': 'Seat Leon 1.0 TSI Style Ecomotive',
 'transmission': 'manual',
 'trim': 'Style Ecomotive',
 'year': 2015}
2026-03-28 05:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VJ06664%27 HTTP/1.1" 200 None
2026-03-28 05:01:03 [auto1.nl] INFO: Saving data for VJ06664: {'auction_closing_time': 1774716686.0, 'created_time': 1774551745.270679, 'last_price_update_time': 1774674063.923298}
2026-03-28 05:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='VJ06664') HTTP/1.1" 204 0
2026-03-28 05:01:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:01:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: b9584b2f-bd34-5fbe-a86c-658e842b7998 with identifier: ZZ83139
2026-03-28 05:01:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: b9584b2f-bd34-5fbe-a86c-658e842b7998 with identifier: ZZ83139
2026-03-28 05:01:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: b9584b2f-bd34-5fbe-a86c-658e842b7998 with identifier: ZZ83139 to the API
2026-03-28 05:01:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:01:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:01:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 177,
 'expiration_date': '2026-03-28T16:36:50Z',
 'fuel_type': 'petrol',
 'id': 'b9584b2f-bd34-5fbe-a86c-658e842b7998',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZZ83139',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'Tucson',
 'odometer': 160670,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-04-05',
 'seller_name': None,
 'title': 'Hyundai Tucson 1.6 TGDI Advantage 2WD',
 'transmission': 'manual',
 'trim': 'Advantage 2WD',
 'year': 2016}
2026-03-28 05:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZZ83139%27 HTTP/1.1" 200 None
2026-03-28 05:01:04 [auto1.nl] INFO: Saving data for ZZ83139: {'auction_closing_time': 1774715810.0, 'created_time': 1774465397.592548, 'last_price_update_time': 1774674064.354531}
2026-03-28 05:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='ZZ83139') HTTP/1.1" 204 0
2026-03-28 05:01:04 [auto1.nl] INFO: Found listing with ID: LB35433
2026-03-28 05:01:04 [auto1.nl] INFO: Found listing with ID: VW91946
2026-03-28 05:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VW91946%27 HTTP/1.1" 200 None
2026-03-28 05:01:04 [auto1.nl] INFO: Scrape type for VW91946: 0
2026-03-28 05:01:04 [auto1.nl] INFO: Found listing with ID: EV30454
2026-03-28 05:01:04 [auto1.nl] INFO: Found listing with ID: AW15981
2026-03-28 05:01:04 [auto1.nl] INFO: Found listing with ID: DW43709
2026-03-28 05:01:04 [auto1.nl] INFO: Found listing with ID: AM68781
2026-03-28 05:01:04 [auto1.nl] INFO: Found listing with ID: MU55364
2026-03-28 05:01:04 [auto1.nl] INFO: Found listing with ID: VV88142
2026-03-28 05:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VV88142%27 HTTP/1.1" 200 None
2026-03-28 05:01:04 [auto1.nl] INFO: Scrape type for VV88142: 0
2026-03-28 05:01:04 [auto1.nl] INFO: Found listing with ID: HC20329
2026-03-28 05:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HC20329%27 HTTP/1.1" 200 None
2026-03-28 05:01:04 [auto1.nl] INFO: Scrape type for HC20329: 2
2026-03-28 05:01:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5ca5eda6-d079-5d96-a46a-da24cc8de4da with identifier: HC20329
2026-03-28 05:01:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5ca5eda6-d079-5d96-a46a-da24cc8de4da with scrape type 2
2026-03-28 05:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5ca5eda6-d079-5d96-a46a-da24cc8de4da with scrape type 2
2026-03-28 05:01:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 5ca5eda6-d079-5d96-a46a-da24cc8de4da, identifier: HC20329
2026-03-28 05:01:04 [auto1.nl] INFO: Found listing with ID: VH08569
2026-03-28 05:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VH08569%27 HTTP/1.1" 200 None
2026-03-28 05:01:04 [auto1.nl] INFO: Scrape type for VH08569: 2
2026-03-28 05:01:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 56d29233-5f25-5e4f-aa4e-14eabb0861d5 with identifier: VH08569
2026-03-28 05:01:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 56d29233-5f25-5e4f-aa4e-14eabb0861d5 with scrape type 2
2026-03-28 05:01:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 56d29233-5f25-5e4f-aa4e-14eabb0861d5 with scrape type 2
2026-03-28 05:01:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 56d29233-5f25-5e4f-aa4e-14eabb0861d5, identifier: VH08569
2026-03-28 05:01:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 5ca5eda6-d079-5d96-a46a-da24cc8de4da with identifier: HC20329
2026-03-28 05:01:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 5ca5eda6-d079-5d96-a46a-da24cc8de4da with identifier: HC20329
2026-03-28 05:01:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 5ca5eda6-d079-5d96-a46a-da24cc8de4da with identifier: HC20329 to the API
2026-03-28 05:01:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:01:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:01:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 163,
 'expiration_date': '2026-03-28T16:21:55Z',
 'fuel_type': 'diesel',
 'id': '5ca5eda6-d079-5d96-a46a-da24cc8de4da',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HC20329',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 234737,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-04-09',
 'seller_name': None,
 'title': 'BMW 3er 320d EfficientDynamics Edition',
 'transmission': 'automatic',
 'trim': 'EfficientDynamics Edition',
 'year': 2015}
2026-03-28 05:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HC20329%27 HTTP/1.1" 200 None
2026-03-28 05:01:04 [auto1.nl] INFO: Saving data for HC20329: {'auction_closing_time': 1774714915.0, 'created_time': 1774465389.834417, 'last_price_update_time': 1774674064.994454}
2026-03-28 05:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='HC20329') HTTP/1.1" 204 0
2026-03-28 05:01:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 56d29233-5f25-5e4f-aa4e-14eabb0861d5 with identifier: VH08569
2026-03-28 05:01:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 56d29233-5f25-5e4f-aa4e-14eabb0861d5 with identifier: VH08569
2026-03-28 05:01:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 56d29233-5f25-5e4f-aa4e-14eabb0861d5 with identifier: VH08569 to the API
2026-03-28 05:01:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:01:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:01:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:21:36Z',
 'fuel_type': 'petrol',
 'id': '56d29233-5f25-5e4f-aa4e-14eabb0861d5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VH08569',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Corsa',
 'odometer': 121516,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-02-22',
 'seller_name': None,
 'title': 'Opel Corsa 1.4 Turbo S ecoFlex',
 'transmission': 'manual',
 'trim': 'S ecoFlex',
 'year': 2018}
2026-03-28 05:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VH08569%27 HTTP/1.1" 200 None
2026-03-28 05:01:05 [auto1.nl] INFO: Saving data for VH08569: {'auction_closing_time': 1774714896.0, 'created_time': 1774551754.674923, 'last_price_update_time': 1774674065.330468}
2026-03-28 05:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='VH08569') HTTP/1.1" 204 0
2026-03-28 05:01:05 [auto1.nl] INFO: Found listing with ID: CN01691
2026-03-28 05:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CN01691%27 HTTP/1.1" 200 None
2026-03-28 05:01:05 [auto1.nl] INFO: Scrape type for CN01691: 2
2026-03-28 05:01:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ecf939d5-a3e4-5f58-80fb-6075691389a6 with identifier: CN01691
2026-03-28 05:01:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ecf939d5-a3e4-5f58-80fb-6075691389a6 with scrape type 2
2026-03-28 05:01:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ecf939d5-a3e4-5f58-80fb-6075691389a6 with scrape type 2
2026-03-28 05:01:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: ecf939d5-a3e4-5f58-80fb-6075691389a6, identifier: CN01691
2026-03-28 05:01:05 [auto1.nl] INFO: Found listing with ID: KT18322
2026-03-28 05:01:05 [auto1.nl] INFO: Found listing with ID: VX18772
2026-03-28 05:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VX18772%27 HTTP/1.1" 200 None
2026-03-28 05:01:05 [auto1.nl] INFO: Scrape type for VX18772: 0
2026-03-28 05:01:05 [auto1.nl] INFO: Found listing with ID: HT16373
2026-03-28 05:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HT16373%27 HTTP/1.1" 200 None
2026-03-28 05:01:05 [auto1.nl] INFO: Scrape type for HT16373: 2
2026-03-28 05:01:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6c9a6376-98d3-5d4e-8fdd-4fdb961d6ce8 with identifier: HT16373
2026-03-28 05:01:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6c9a6376-98d3-5d4e-8fdd-4fdb961d6ce8 with scrape type 2
2026-03-28 05:01:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6c9a6376-98d3-5d4e-8fdd-4fdb961d6ce8 with scrape type 2
2026-03-28 05:01:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 6c9a6376-98d3-5d4e-8fdd-4fdb961d6ce8, identifier: HT16373
2026-03-28 05:01:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: ecf939d5-a3e4-5f58-80fb-6075691389a6 with identifier: CN01691
2026-03-28 05:01:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: ecf939d5-a3e4-5f58-80fb-6075691389a6 with identifier: CN01691
2026-03-28 05:01:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: ecf939d5-a3e4-5f58-80fb-6075691389a6 with identifier: CN01691 to the API
2026-03-28 05:01:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:01:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:01:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-28T16:27:57Z',
 'fuel_type': 'petrol',
 'id': 'ecf939d5-a3e4-5f58-80fb-6075691389a6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CN01691',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 144674,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-04-24',
 'seller_name': None,
 'title': 'BMW 3er 320i GT M Sport',
 'transmission': 'automatic',
 'trim': 'M Sport',
 'year': 2018}
2026-03-28 05:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CN01691%27 HTTP/1.1" 200 None
2026-03-28 05:01:05 [auto1.nl] INFO: Saving data for CN01691: {'auction_closing_time': 1774715277.0, 'created_time': 1774465259.031687, 'last_price_update_time': 1774674065.955639}
2026-03-28 05:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='CN01691') HTTP/1.1" 204 0
2026-03-28 05:01:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 6c9a6376-98d3-5d4e-8fdd-4fdb961d6ce8 with identifier: HT16373
2026-03-28 05:01:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 6c9a6376-98d3-5d4e-8fdd-4fdb961d6ce8 with identifier: HT16373
2026-03-28 05:01:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 6c9a6376-98d3-5d4e-8fdd-4fdb961d6ce8 with identifier: HT16373 to the API
2026-03-28 05:01:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:01:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:01:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-28T16:13:46Z',
 'fuel_type': 'petrol',
 'id': '6c9a6376-98d3-5d4e-8fdd-4fdb961d6ce8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HT16373',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Corsa',
 'odometer': 252580,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2002-06-26',
 'seller_name': None,
 'title': 'Opel Corsa 1.2 Comfort',
 'transmission': 'manual',
 'trim': 'Comfort',
 'year': 2002}
2026-03-28 05:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HT16373%27 HTTP/1.1" 200 None
2026-03-28 05:01:06 [auto1.nl] INFO: Saving data for HT16373: {'auction_closing_time': 1774714426.0, 'created_time': 1774465337.381073, 'last_price_update_time': 1774674066.444122}
2026-03-28 05:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='HT16373') HTTP/1.1" 204 0
2026-03-28 05:01:06 [auto1.nl] INFO: Found listing with ID: ZL96236
2026-03-28 05:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZL96236%27 HTTP/1.1" 200 None
2026-03-28 05:01:06 [auto1.nl] INFO: Scrape type for ZL96236: 0
2026-03-28 05:01:06 [auto1.nl] INFO: Found listing with ID: JX67409
2026-03-28 05:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JX67409%27 HTTP/1.1" 200 None
2026-03-28 05:01:06 [auto1.nl] INFO: Scrape type for JX67409: 0
2026-03-28 05:01:06 [auto1.nl] INFO: Found listing with ID: DA29812
2026-03-28 05:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DA29812%27 HTTP/1.1" 200 None
2026-03-28 05:01:06 [auto1.nl] INFO: Scrape type for DA29812: 2
2026-03-28 05:01:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 119cd623-a1bd-52d3-bf5f-c55fcd9bdda9 with identifier: DA29812
2026-03-28 05:01:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 119cd623-a1bd-52d3-bf5f-c55fcd9bdda9 with scrape type 2
2026-03-28 05:01:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 119cd623-a1bd-52d3-bf5f-c55fcd9bdda9 with scrape type 2
2026-03-28 05:01:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 119cd623-a1bd-52d3-bf5f-c55fcd9bdda9, identifier: DA29812
2026-03-28 05:01:06 [auto1.nl] INFO: Found listing with ID: LZ16632
2026-03-28 05:01:06 [auto1.nl] INFO: Found listing with ID: ML63258
2026-03-28 05:01:06 [auto1.nl] INFO: Found listing with ID: JX76832
2026-03-28 05:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JX76832%27 HTTP/1.1" 200 None
2026-03-28 05:01:06 [auto1.nl] INFO: Scrape type for JX76832: 0
2026-03-28 05:01:06 [auto1.nl] INFO: Found listing with ID: LN57581
2026-03-28 05:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LN57581%27 HTTP/1.1" 200 None
2026-03-28 05:01:06 [auto1.nl] INFO: Scrape type for LN57581: 0
2026-03-28 05:01:06 [auto1.nl] INFO: Found listing with ID: GY66252
2026-03-28 05:01:06 [auto1.nl] INFO: Found listing with ID: UD70514
2026-03-28 05:01:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 119cd623-a1bd-52d3-bf5f-c55fcd9bdda9 with identifier: DA29812
2026-03-28 05:01:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 119cd623-a1bd-52d3-bf5f-c55fcd9bdda9 with identifier: DA29812
2026-03-28 05:01:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 119cd623-a1bd-52d3-bf5f-c55fcd9bdda9 with identifier: DA29812 to the API
2026-03-28 05:01:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:01:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:01:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 70,
 'expiration_date': '2026-03-28T16:19:06Z',
 'fuel_type': 'petrol',
 'id': '119cd623-a1bd-52d3-bf5f-c55fcd9bdda9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DA29812',
 'listing': 'auction',
 'make': 'Fiat',
 'model': '500',
 'odometer': 35303,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-12-29',
 'seller_name': None,
 'title': 'Fiat 500 1.0 Mild-Hybrid Lounge',
 'transmission': 'manual',
 'trim': 'Lounge',
 'year': 2014}
2026-03-28 05:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DA29812%27 HTTP/1.1" 200 None
2026-03-28 05:01:06 [auto1.nl] INFO: Saving data for DA29812: {'auction_closing_time': 1774714746.0, 'created_time': 1774551752.070022, 'last_price_update_time': 1774674066.989552}
2026-03-28 05:01:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='DA29812') HTTP/1.1" 204 0
2026-03-28 05:01:07 [auto1.nl] INFO: Found listing with ID: BF79856
2026-03-28 05:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BF79856%27 HTTP/1.1" 200 None
2026-03-28 05:01:07 [auto1.nl] INFO: Scrape type for BF79856: 0
2026-03-28 05:01:07 [auto1.nl] INFO: Found listing with ID: TP38124
2026-03-28 05:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TP38124%27 HTTP/1.1" 200 None
2026-03-28 05:01:07 [auto1.nl] INFO: Scrape type for TP38124: 0
2026-03-28 05:01:07 [auto1.nl] INFO: Found listing with ID: PV96248
2026-03-28 05:01:07 [auto1.nl] INFO: Found listing with ID: WP19214
2026-03-28 05:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WP19214%27 HTTP/1.1" 200 None
2026-03-28 05:01:07 [auto1.nl] INFO: Scrape type for WP19214: 2
2026-03-28 05:01:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3e52eee4-1461-56dd-af97-6d8146fabe34 with identifier: WP19214
2026-03-28 05:01:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3e52eee4-1461-56dd-af97-6d8146fabe34 with scrape type 2
2026-03-28 05:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3e52eee4-1461-56dd-af97-6d8146fabe34 with scrape type 2
2026-03-28 05:01:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 3e52eee4-1461-56dd-af97-6d8146fabe34, identifier: WP19214
2026-03-28 05:01:07 [scrapy.extensions.logstats] INFO: Crawled 9 pages (at 9 pages/min), scraped 24 items (at 24 items/min)
2026-03-28 05:01:07 [scrapy.extensions.memusage] INFO: Peak memory usage is 154MiB
2026-03-28 05:01:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 3e52eee4-1461-56dd-af97-6d8146fabe34 with identifier: WP19214
2026-03-28 05:01:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 3e52eee4-1461-56dd-af97-6d8146fabe34 with identifier: WP19214
2026-03-28 05:01:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 3e52eee4-1461-56dd-af97-6d8146fabe34 with identifier: WP19214 to the API
2026-03-28 05:01:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:01:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:01:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-28T16:10:30Z',
 'fuel_type': 'petrol',
 'id': '3e52eee4-1461-56dd-af97-6d8146fabe34',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WP19214',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Meriva',
 'odometer': 143760,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-07-05',
 'seller_name': None,
 'title': 'Opel Meriva 1.4 Edition',
 'transmission': 'manual',
 'trim': 'Edition',
 'year': 2010}
2026-03-28 05:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WP19214%27 HTTP/1.1" 200 None
2026-03-28 05:01:07 [auto1.nl] INFO: Saving data for WP19214: {'auction_closing_time': 1774714230.0, 'created_time': 1773135234.940776, 'last_price_update_time': 1774674067.561231}
2026-03-28 05:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='WP19214') HTTP/1.1" 204 0
2026-03-28 05:01:07 [auto1.nl] INFO: Found listing with ID: BC50110
2026-03-28 05:01:07 [auto1.nl] INFO: Found listing with ID: KN68466
2026-03-28 05:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KN68466%27 HTTP/1.1" 200 None
2026-03-28 05:01:07 [auto1.nl] INFO: Scrape type for KN68466: 2
2026-03-28 05:01:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 822cb56c-b28f-5eaa-848e-237f353a33df with identifier: KN68466
2026-03-28 05:01:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 822cb56c-b28f-5eaa-848e-237f353a33df with scrape type 2
2026-03-28 05:01:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 822cb56c-b28f-5eaa-848e-237f353a33df with scrape type 2
2026-03-28 05:01:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 822cb56c-b28f-5eaa-848e-237f353a33df, identifier: KN68466
2026-03-28 05:01:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 822cb56c-b28f-5eaa-848e-237f353a33df with identifier: KN68466
2026-03-28 05:01:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 822cb56c-b28f-5eaa-848e-237f353a33df with identifier: KN68466
2026-03-28 05:01:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 822cb56c-b28f-5eaa-848e-237f353a33df with identifier: KN68466 to the API
2026-03-28 05:01:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:01:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:01:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-28T16:29:45Z',
 'fuel_type': 'petrol',
 'id': '822cb56c-b28f-5eaa-848e-237f353a33df',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KN68466',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 149023,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-05-18',
 'seller_name': None,
 'title': 'BMW 3er 318i Sport Line',
 'transmission': 'automatic',
 'trim': 'Sport Line',
 'year': 2017}
2026-03-28 05:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KN68466%27 HTTP/1.1" 200 None
2026-03-28 05:01:08 [auto1.nl] INFO: Saving data for KN68466: {'auction_closing_time': 1774715385.0, 'created_time': 1774465283.638733, 'last_price_update_time': 1774674068.143844}
2026-03-28 05:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='KN68466') HTTP/1.1" 204 0
2026-03-28 05:01:08 [auto1.nl] INFO: Found listing with ID: AY58936
2026-03-28 05:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AY58936%27 HTTP/1.1" 200 None
2026-03-28 05:01:08 [auto1.nl] INFO: Scrape type for AY58936: 2
2026-03-28 05:01:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d280cf38-61cc-5994-9096-9b17c21252fe with identifier: AY58936
2026-03-28 05:01:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d280cf38-61cc-5994-9096-9b17c21252fe with scrape type 2
2026-03-28 05:01:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d280cf38-61cc-5994-9096-9b17c21252fe with scrape type 2
2026-03-28 05:01:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: d280cf38-61cc-5994-9096-9b17c21252fe, identifier: AY58936
2026-03-28 05:01:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: d280cf38-61cc-5994-9096-9b17c21252fe with identifier: AY58936
2026-03-28 05:01:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: d280cf38-61cc-5994-9096-9b17c21252fe with identifier: AY58936
2026-03-28 05:01:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: d280cf38-61cc-5994-9096-9b17c21252fe with identifier: AY58936 to the API
2026-03-28 05:01:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:01:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:01:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 200,
 'expiration_date': '2026-03-28T16:13:46Z',
 'fuel_type': 'petrol',
 'id': 'd280cf38-61cc-5994-9096-9b17c21252fe',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AY58936',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'Juke',
 'odometer': 174784,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-03-18',
 'seller_name': None,
 'title': 'Nissan Juke 1.6 Nismo',
 'transmission': 'manual',
 'trim': 'Nismo',
 'year': 2014}
2026-03-28 05:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AY58936%27 HTTP/1.1" 200 None
2026-03-28 05:01:08 [auto1.nl] INFO: Saving data for AY58936: {'auction_closing_time': 1774714426.0, 'created_time': 1774353784.375024, 'last_price_update_time': 1774674068.646914}
2026-03-28 05:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='AY58936') HTTP/1.1" 204 0
2026-03-28 05:01:08 [auto1.nl] INFO: Found listing with ID: VV45583
2026-03-28 05:01:08 [auto1.nl] INFO: Found listing with ID: WF02438
2026-03-28 05:01:08 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:01:08 [auto1.nl] INFO: Channel: 24h | Page: 6 | totalHits: 917 | hits on page: 40
2026-03-28 05:01:08 [auto1.nl] INFO: Found listing with ID: DW65450
2026-03-28 05:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DW65450%27 HTTP/1.1" 200 None
2026-03-28 05:01:08 [auto1.nl] INFO: Scrape type for DW65450: 0
2026-03-28 05:01:08 [auto1.nl] INFO: Found listing with ID: RL18676
2026-03-28 05:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RL18676%27 HTTP/1.1" 200 None
2026-03-28 05:01:08 [auto1.nl] INFO: Scrape type for RL18676: 0
2026-03-28 05:01:08 [auto1.nl] INFO: Found listing with ID: RX16781
2026-03-28 05:01:08 [auto1.nl] INFO: Found listing with ID: BZ05855
2026-03-28 05:01:08 [auto1.nl] INFO: Found listing with ID: LA33547
2026-03-28 05:01:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LA33547%27 HTTP/1.1" 200 None
2026-03-28 05:01:09 [auto1.nl] INFO: Scrape type for LA33547: 0
2026-03-28 05:01:09 [auto1.nl] INFO: Found listing with ID: XS82099
2026-03-28 05:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XS82099%27 HTTP/1.1" 200 None
2026-03-28 05:01:09 [auto1.nl] INFO: Scrape type for XS82099: 2
2026-03-28 05:01:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8d9127a3-ed8a-560e-a48b-46f27b5c3305 with identifier: XS82099
2026-03-28 05:01:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8d9127a3-ed8a-560e-a48b-46f27b5c3305 with scrape type 2
2026-03-28 05:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8d9127a3-ed8a-560e-a48b-46f27b5c3305 with scrape type 2
2026-03-28 05:01:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 8d9127a3-ed8a-560e-a48b-46f27b5c3305, identifier: XS82099
2026-03-28 05:01:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 8d9127a3-ed8a-560e-a48b-46f27b5c3305 with identifier: XS82099
2026-03-28 05:01:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 8d9127a3-ed8a-560e-a48b-46f27b5c3305 with identifier: XS82099
2026-03-28 05:01:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 8d9127a3-ed8a-560e-a48b-46f27b5c3305 with identifier: XS82099 to the API
2026-03-28 05:01:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:01:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:01:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 143,
 'expiration_date': '2026-03-28T16:01:23Z',
 'fuel_type': 'petrol',
 'id': '8d9127a3-ed8a-560e-a48b-46f27b5c3305',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XS82099',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 196590,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-02-01',
 'seller_name': None,
 'title': 'BMW 3er 318i',
 'transmission': 'manual',
 'trim': '',
 'year': 2008}
2026-03-28 05:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XS82099%27 HTTP/1.1" 200 None
2026-03-28 05:01:09 [auto1.nl] INFO: Saving data for XS82099: {'auction_closing_time': 1774713683.0, 'created_time': 1774465402.581234, 'last_price_update_time': 1774674069.445059}
2026-03-28 05:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='XS82099') HTTP/1.1" 204 0
2026-03-28 05:01:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:01:09 [auto1.nl] INFO: Found listing with ID: BF50619
2026-03-28 05:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BF50619%27 HTTP/1.1" 200 None
2026-03-28 05:01:09 [auto1.nl] INFO: Scrape type for BF50619: 0
2026-03-28 05:01:09 [auto1.nl] INFO: Found listing with ID: JK19053
2026-03-28 05:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JK19053%27 HTTP/1.1" 200 None
2026-03-28 05:01:09 [auto1.nl] INFO: Scrape type for JK19053: 0
2026-03-28 05:01:09 [auto1.nl] INFO: Found listing with ID: GC72456
2026-03-28 05:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GC72456%27 HTTP/1.1" 200 None
2026-03-28 05:01:09 [auto1.nl] INFO: Scrape type for GC72456: 2
2026-03-28 05:01:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 01a21d97-249e-59f9-8b86-ebf17b3e32b2 with identifier: GC72456
2026-03-28 05:01:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 01a21d97-249e-59f9-8b86-ebf17b3e32b2 with scrape type 2
2026-03-28 05:01:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 01a21d97-249e-59f9-8b86-ebf17b3e32b2 with scrape type 2
2026-03-28 05:01:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 01a21d97-249e-59f9-8b86-ebf17b3e32b2, identifier: GC72456
2026-03-28 05:01:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 01a21d97-249e-59f9-8b86-ebf17b3e32b2 with identifier: GC72456
2026-03-28 05:01:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 01a21d97-249e-59f9-8b86-ebf17b3e32b2 with identifier: GC72456
2026-03-28 05:01:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 01a21d97-249e-59f9-8b86-ebf17b3e32b2 with identifier: GC72456 to the API
2026-03-28 05:01:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:01:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:01:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-28T16:45:03Z',
 'fuel_type': 'petrol',
 'id': '01a21d97-249e-59f9-8b86-ebf17b3e32b2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GC72456',
 'listing': 'auction',
 'make': 'MINI',
 'model': 'MINI',
 'odometer': 144606,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-01-22',
 'seller_name': None,
 'title': 'MINI One',
 'transmission': 'manual',
 'trim': '',
 'year': 2010}
2026-03-28 05:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GC72456%27 HTTP/1.1" 200 None
2026-03-28 05:01:10 [auto1.nl] INFO: Saving data for GC72456: {'auction_closing_time': 1774716303.0, 'created_time': 1774465393.943578, 'last_price_update_time': 1774674070.140319}
2026-03-28 05:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='GC72456') HTTP/1.1" 204 0
2026-03-28 05:01:10 [auto1.nl] INFO: Found listing with ID: LU83430
2026-03-28 05:01:10 [auto1.nl] INFO: Found listing with ID: GP94169
2026-03-28 05:01:10 [auto1.nl] INFO: Found listing with ID: KD04773
2026-03-28 05:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KD04773%27 HTTP/1.1" 200 None
2026-03-28 05:01:10 [auto1.nl] INFO: Scrape type for KD04773: 0
2026-03-28 05:01:10 [auto1.nl] INFO: Found listing with ID: JK88621
2026-03-28 05:01:10 [auto1.nl] INFO: Found listing with ID: HY67553
2026-03-28 05:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HY67553%27 HTTP/1.1" 200 None
2026-03-28 05:01:10 [auto1.nl] INFO: Scrape type for HY67553: 2
2026-03-28 05:01:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7ac9d23c-c2d9-5aef-b6e1-1eba630ea3b4 with identifier: HY67553
2026-03-28 05:01:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7ac9d23c-c2d9-5aef-b6e1-1eba630ea3b4 with scrape type 2
2026-03-28 05:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7ac9d23c-c2d9-5aef-b6e1-1eba630ea3b4 with scrape type 2
2026-03-28 05:01:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 7ac9d23c-c2d9-5aef-b6e1-1eba630ea3b4, identifier: HY67553
2026-03-28 05:01:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 7ac9d23c-c2d9-5aef-b6e1-1eba630ea3b4 with identifier: HY67553
2026-03-28 05:01:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 7ac9d23c-c2d9-5aef-b6e1-1eba630ea3b4 with identifier: HY67553
2026-03-28 05:01:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 7ac9d23c-c2d9-5aef-b6e1-1eba630ea3b4 with identifier: HY67553 to the API
2026-03-28 05:01:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:01:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:01:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-28T16:36:46Z',
 'fuel_type': 'petrol',
 'id': '7ac9d23c-c2d9-5aef-b6e1-1eba630ea3b4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HY67553',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '2008',
 'odometer': 180762,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-08-29',
 'seller_name': None,
 'title': 'Peugeot 2008 1.6 Active',
 'transmission': 'manual',
 'trim': 'Active',
 'year': 2013}
2026-03-28 05:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HY67553%27 HTTP/1.1" 200 None
2026-03-28 05:01:10 [auto1.nl] INFO: Saving data for HY67553: {'auction_closing_time': 1774715806.0, 'created_time': 1774465257.138808, 'last_price_update_time': 1774674070.655254}
2026-03-28 05:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='HY67553') HTTP/1.1" 204 0
2026-03-28 05:01:10 [auto1.nl] INFO: Found listing with ID: AJ38016
2026-03-28 05:01:10 [auto1.nl] INFO: Found listing with ID: LN29511
2026-03-28 05:01:10 [auto1.nl] INFO: Found listing with ID: MJ47722
2026-03-28 05:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MJ47722%27 HTTP/1.1" 200 None
2026-03-28 05:01:10 [auto1.nl] INFO: Scrape type for MJ47722: 0
2026-03-28 05:01:10 [auto1.nl] INFO: Found listing with ID: EF55235
2026-03-28 05:01:10 [auto1.nl] INFO: Found listing with ID: SA72680
2026-03-28 05:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SA72680%27 HTTP/1.1" 200 None
2026-03-28 05:01:10 [auto1.nl] INFO: Scrape type for SA72680: 0
2026-03-28 05:01:10 [auto1.nl] INFO: Found listing with ID: JF44438
2026-03-28 05:01:10 [auto1.nl] INFO: Found listing with ID: MM94423
2026-03-28 05:01:10 [auto1.nl] INFO: Found listing with ID: GW56825
2026-03-28 05:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GW56825%27 HTTP/1.1" 200 None
2026-03-28 05:01:10 [auto1.nl] INFO: Scrape type for GW56825: 2
2026-03-28 05:01:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3c0d4bc6-5221-5ed1-a467-12223b37b200 with identifier: GW56825
2026-03-28 05:01:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3c0d4bc6-5221-5ed1-a467-12223b37b200 with scrape type 2
2026-03-28 05:01:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3c0d4bc6-5221-5ed1-a467-12223b37b200 with scrape type 2
2026-03-28 05:01:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 3c0d4bc6-5221-5ed1-a467-12223b37b200, identifier: GW56825
2026-03-28 05:01:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 3c0d4bc6-5221-5ed1-a467-12223b37b200 with identifier: GW56825
2026-03-28 05:01:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 3c0d4bc6-5221-5ed1-a467-12223b37b200 with identifier: GW56825
2026-03-28 05:01:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 3c0d4bc6-5221-5ed1-a467-12223b37b200 with identifier: GW56825 to the API
2026-03-28 05:01:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:01:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:01:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 155,
 'expiration_date': '2026-03-28T16:41:49Z',
 'fuel_type': 'petrol',
 'id': '3c0d4bc6-5221-5ed1-a467-12223b37b200',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GW56825',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '3008',
 'odometer': 65653,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-03-14',
 'seller_name': None,
 'title': 'Peugeot 3008 1.6 THP Premium',
 'transmission': 'automatic',
 'trim': 'Premium',
 'year': 2011}
2026-03-28 05:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GW56825%27 HTTP/1.1" 200 None
2026-03-28 05:01:11 [auto1.nl] INFO: Saving data for GW56825: {'auction_closing_time': 1774716109.0, 'created_time': 1773131953.305068, 'last_price_update_time': 1774674071.208139}
2026-03-28 05:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='GW56825') HTTP/1.1" 204 0
2026-03-28 05:01:11 [auto1.nl] INFO: Found listing with ID: MB44193
2026-03-28 05:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MB44193%27 HTTP/1.1" 200 None
2026-03-28 05:01:11 [auto1.nl] INFO: Scrape type for MB44193: 2
2026-03-28 05:01:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f0aa2321-5a6a-5140-a6b9-eda5979076f8 with identifier: MB44193
2026-03-28 05:01:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f0aa2321-5a6a-5140-a6b9-eda5979076f8 with scrape type 2
2026-03-28 05:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f0aa2321-5a6a-5140-a6b9-eda5979076f8 with scrape type 2
2026-03-28 05:01:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: f0aa2321-5a6a-5140-a6b9-eda5979076f8, identifier: MB44193
2026-03-28 05:01:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: f0aa2321-5a6a-5140-a6b9-eda5979076f8 with identifier: MB44193
2026-03-28 05:01:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: f0aa2321-5a6a-5140-a6b9-eda5979076f8 with identifier: MB44193
2026-03-28 05:01:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: f0aa2321-5a6a-5140-a6b9-eda5979076f8 with identifier: MB44193 to the API
2026-03-28 05:01:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:01:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:01:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-28T16:48:34Z',
 'fuel_type': 'petrol',
 'id': 'f0aa2321-5a6a-5140-a6b9-eda5979076f8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MB44193',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 151351,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-08-31',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 1.4 TSI Lounge BlueMotion Tech.',
 'transmission': 'automatic',
 'trim': 'Lounge BlueMotion Tech.',
 'year': 2015}
2026-03-28 05:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MB44193%27 HTTP/1.1" 200 None
2026-03-28 05:01:11 [auto1.nl] INFO: Saving data for MB44193: {'auction_closing_time': 1774716514.0, 'created_time': 1774551711.717702, 'last_price_update_time': 1774674071.771233}
2026-03-28 05:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='MB44193') HTTP/1.1" 204 0
2026-03-28 05:01:11 [auto1.nl] INFO: Found listing with ID: JG46150
2026-03-28 05:01:11 [auto1.nl] INFO: Found listing with ID: VB13156
2026-03-28 05:01:11 [auto1.nl] INFO: Found listing with ID: KM38195
2026-03-28 05:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KM38195%27 HTTP/1.1" 200 None
2026-03-28 05:01:11 [auto1.nl] INFO: Scrape type for KM38195: 2
2026-03-28 05:01:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2befa284-2865-58bc-922a-a424213734b7 with identifier: KM38195
2026-03-28 05:01:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2befa284-2865-58bc-922a-a424213734b7 with scrape type 2
2026-03-28 05:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2befa284-2865-58bc-922a-a424213734b7 with scrape type 2
2026-03-28 05:01:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 2befa284-2865-58bc-922a-a424213734b7, identifier: KM38195
2026-03-28 05:01:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 2befa284-2865-58bc-922a-a424213734b7 with identifier: KM38195
2026-03-28 05:01:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 2befa284-2865-58bc-922a-a424213734b7 with identifier: KM38195
2026-03-28 05:01:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 2befa284-2865-58bc-922a-a424213734b7 with identifier: KM38195 to the API
2026-03-28 05:01:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:01:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:01:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-28T16:56:26Z',
 'fuel_type': 'petrol',
 'id': '2befa284-2865-58bc-922a-a424213734b7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KM38195',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 100691,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-10-31',
 'seller_name': None,
 'title': 'Volkswagen Polo 1.0 TSI Comfortline',
 'transmission': 'manual',
 'trim': 'Comfortline',
 'year': 2019}
2026-03-28 05:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KM38195%27 HTTP/1.1" 200 None
2026-03-28 05:01:12 [auto1.nl] INFO: Saving data for KM38195: {'auction_closing_time': 1774716986.0, 'created_time': 1774465258.117802, 'last_price_update_time': 1774674072.256696}
2026-03-28 05:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='KM38195') HTTP/1.1" 204 0
2026-03-28 05:01:12 [auto1.nl] INFO: Found listing with ID: YT29313
2026-03-28 05:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YT29313%27 HTTP/1.1" 200 None
2026-03-28 05:01:12 [auto1.nl] INFO: Scrape type for YT29313: 0
2026-03-28 05:01:12 [auto1.nl] INFO: Found listing with ID: LK58980
2026-03-28 05:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LK58980%27 HTTP/1.1" 200 None
2026-03-28 05:01:12 [auto1.nl] INFO: Scrape type for LK58980: 0
2026-03-28 05:01:12 [auto1.nl] INFO: Found listing with ID: LM76108
2026-03-28 05:01:12 [auto1.nl] INFO: Found listing with ID: PC25819
2026-03-28 05:01:12 [auto1.nl] INFO: Found listing with ID: FL02627
2026-03-28 05:01:12 [auto1.nl] INFO: Found listing with ID: HX62268
2026-03-28 05:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HX62268%27 HTTP/1.1" 200 None
2026-03-28 05:01:12 [auto1.nl] INFO: Scrape type for HX62268: 0
2026-03-28 05:01:12 [auto1.nl] INFO: Found listing with ID: BE76328
2026-03-28 05:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BE76328%27 HTTP/1.1" 200 None
2026-03-28 05:01:12 [auto1.nl] INFO: Scrape type for BE76328: 2
2026-03-28 05:01:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: eba1053f-3ea5-5985-bb14-89f69274259b with identifier: BE76328
2026-03-28 05:01:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item eba1053f-3ea5-5985-bb14-89f69274259b with scrape type 2
2026-03-28 05:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item eba1053f-3ea5-5985-bb14-89f69274259b with scrape type 2
2026-03-28 05:01:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: eba1053f-3ea5-5985-bb14-89f69274259b, identifier: BE76328
2026-03-28 05:01:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: eba1053f-3ea5-5985-bb14-89f69274259b with identifier: BE76328
2026-03-28 05:01:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: eba1053f-3ea5-5985-bb14-89f69274259b with identifier: BE76328
2026-03-28 05:01:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: eba1053f-3ea5-5985-bb14-89f69274259b with identifier: BE76328 to the API
2026-03-28 05:01:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:01:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:01:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 136,
 'expiration_date': '2026-03-28T16:39:53Z',
 'fuel_type': 'hybrid',
 'id': 'eba1053f-3ea5-5985-bb14-89f69274259b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BE76328',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'Auris Touring Sports',
 'odometer': 172131,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-10-08',
 'seller_name': None,
 'title': 'Toyota Auris Touring Sports 1.8 Hybrid Active',
 'transmission': 'automatic',
 'trim': 'Active',
 'year': 2015}
2026-03-28 05:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BE76328%27 HTTP/1.1" 200 None
2026-03-28 05:01:12 [auto1.nl] INFO: Saving data for BE76328: {'auction_closing_time': 1774715993.0, 'created_time': 1773132260.650484, 'last_price_update_time': 1774674072.829082}
2026-03-28 05:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='BE76328') HTTP/1.1" 204 0
2026-03-28 05:01:12 [auto1.nl] INFO: Found listing with ID: UC83701
2026-03-28 05:01:12 [auto1.nl] INFO: Found listing with ID: BH50437
2026-03-28 05:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BH50437%27 HTTP/1.1" 200 None
2026-03-28 05:01:12 [auto1.nl] INFO: Scrape type for BH50437: 0
2026-03-28 05:01:12 [auto1.nl] INFO: Found listing with ID: PN34137
2026-03-28 05:01:12 [auto1.nl] INFO: Found listing with ID: TG03602
2026-03-28 05:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TG03602%27 HTTP/1.1" 200 None
2026-03-28 05:01:12 [auto1.nl] INFO: Scrape type for TG03602: 2
2026-03-28 05:01:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f9aa66a5-e319-5cd5-b472-73d349d91761 with identifier: TG03602
2026-03-28 05:01:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f9aa66a5-e319-5cd5-b472-73d349d91761 with scrape type 2
2026-03-28 05:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f9aa66a5-e319-5cd5-b472-73d349d91761 with scrape type 2
2026-03-28 05:01:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: f9aa66a5-e319-5cd5-b472-73d349d91761, identifier: TG03602
2026-03-28 05:01:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: f9aa66a5-e319-5cd5-b472-73d349d91761 with identifier: TG03602
2026-03-28 05:01:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 05:01:13 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=orange HTTP/1.1" 200 None
2026-03-28 05:01:13 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 05:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 05:01:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: f9aa66a5-e319-5cd5-b472-73d349d91761 with identifier: TG03602
2026-03-28 05:01:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: f9aa66a5-e319-5cd5-b472-73d349d91761 with identifier: TG03602 to the API
2026-03-28 05:01:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:01:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:01:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'orange',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-28T16:30:37Z',
 'fuel_type': 'petrol',
 'id': 'f9aa66a5-e319-5cd5-b472-73d349d91761',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TG03602',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'T5 Transporter',
 'odometer': 147743,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-03-06',
 'seller_name': None,
 'title': 'Volkswagen T5 Transporter 2.0 Kasten lang',
 'transmission': 'manual',
 'trim': 'Kasten lang',
 'year': 2012}
2026-03-28 05:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TG03602%27 HTTP/1.1" 200 None
2026-03-28 05:01:13 [auto1.nl] INFO: Saving data for TG03602: {'auction_closing_time': 1774715437.0, 'created_time': 1774465263.366845, 'last_price_update_time': 1774674073.513533}
2026-03-28 05:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='TG03602') HTTP/1.1" 204 0
2026-03-28 05:01:13 [auto1.nl] INFO: Found listing with ID: AU62322
2026-03-28 05:01:13 [auto1.nl] INFO: Found listing with ID: PH10928
2026-03-28 05:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PH10928%27 HTTP/1.1" 200 None
2026-03-28 05:01:13 [auto1.nl] INFO: Scrape type for PH10928: 0
2026-03-28 05:01:13 [auto1.nl] INFO: Found listing with ID: VD56637
2026-03-28 05:01:13 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:01:13 [auto1.nl] INFO: Channel: 24h | Page: 7 | totalHits: 917 | hits on page: 40
2026-03-28 05:01:13 [auto1.nl] INFO: Found listing with ID: CP13228
2026-03-28 05:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CP13228%27 HTTP/1.1" 200 None
2026-03-28 05:01:13 [auto1.nl] INFO: Scrape type for CP13228: 2
2026-03-28 05:01:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 36030cc9-5447-515f-960b-19a2d3646feb with identifier: CP13228
2026-03-28 05:01:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 36030cc9-5447-515f-960b-19a2d3646feb with scrape type 2
2026-03-28 05:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 36030cc9-5447-515f-960b-19a2d3646feb with scrape type 2
2026-03-28 05:01:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 36030cc9-5447-515f-960b-19a2d3646feb, identifier: CP13228
2026-03-28 05:01:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 36030cc9-5447-515f-960b-19a2d3646feb with identifier: CP13228
2026-03-28 05:01:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 36030cc9-5447-515f-960b-19a2d3646feb with identifier: CP13228
2026-03-28 05:01:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 36030cc9-5447-515f-960b-19a2d3646feb with identifier: CP13228 to the API
2026-03-28 05:01:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:01:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:01:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 204,
 'expiration_date': '2026-03-28T16:28:24Z',
 'fuel_type': 'hybrid',
 'id': '36030cc9-5447-515f-960b-19a2d3646feb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CP13228',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A3 Sportback',
 'odometer': 195551,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-08-13',
 'seller_name': None,
 'title': 'Audi A3 Sportback 1.4 TFSI e-tron Ambition',
 'transmission': 'automatic',
 'trim': 'Ambition',
 'year': 2015}
2026-03-28 05:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CP13228%27 HTTP/1.1" 200 None
2026-03-28 05:01:14 [auto1.nl] INFO: Saving data for CP13228: {'auction_closing_time': 1774715304.0, 'created_time': 1774551677.374904, 'last_price_update_time': 1774674074.317753}
2026-03-28 05:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='CP13228') HTTP/1.1" 204 0
2026-03-28 05:01:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:01:14 [auto1.nl] INFO: Found listing with ID: MW67597
2026-03-28 05:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MW67597%27 HTTP/1.1" 200 None
2026-03-28 05:01:14 [auto1.nl] INFO: Scrape type for MW67597: 0
2026-03-28 05:01:14 [auto1.nl] INFO: Found listing with ID: DH15529
2026-03-28 05:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DH15529%27 HTTP/1.1" 200 None
2026-03-28 05:01:14 [auto1.nl] INFO: Scrape type for DH15529: 0
2026-03-28 05:01:14 [auto1.nl] INFO: Found listing with ID: CL96583
2026-03-28 05:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CL96583%27 HTTP/1.1" 200 None
2026-03-28 05:01:14 [auto1.nl] INFO: Scrape type for CL96583: 2
2026-03-28 05:01:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1692a952-d16e-5319-b4b5-5c957492c775 with identifier: CL96583
2026-03-28 05:01:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1692a952-d16e-5319-b4b5-5c957492c775 with scrape type 2
2026-03-28 05:01:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1692a952-d16e-5319-b4b5-5c957492c775 with scrape type 2
2026-03-28 05:01:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 1692a952-d16e-5319-b4b5-5c957492c775, identifier: CL96583
2026-03-28 05:01:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 1692a952-d16e-5319-b4b5-5c957492c775 with identifier: CL96583
2026-03-28 05:01:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 1692a952-d16e-5319-b4b5-5c957492c775 with identifier: CL96583
2026-03-28 05:01:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 1692a952-d16e-5319-b4b5-5c957492c775 with identifier: CL96583 to the API
2026-03-28 05:01:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:01:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:01:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'orange',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 173,
 'expiration_date': '2026-03-28T16:35:49Z',
 'fuel_type': 'petrol',
 'id': '1692a952-d16e-5319-b4b5-5c957492c775',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CL96583',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'Santa Fe',
 'odometer': 160186,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2002-10-15',
 'seller_name': None,
 'title': 'Hyundai Santa Fe 2.7 V6 GLS',
 'transmission': 'automatic',
 'trim': 'GLS',
 'year': 2002}
2026-03-28 05:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CL96583%27 HTTP/1.1" 200 None
2026-03-28 05:01:14 [auto1.nl] INFO: Saving data for CL96583: {'auction_closing_time': 1774715749.0, 'created_time': 1774551746.138415, 'last_price_update_time': 1774674074.833592}
2026-03-28 05:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='CL96583') HTTP/1.1" 204 0
2026-03-28 05:01:14 [auto1.nl] INFO: Found listing with ID: YS68012
2026-03-28 05:01:14 [auto1.nl] INFO: Found listing with ID: AS79214
2026-03-28 05:01:14 [auto1.nl] INFO: Found listing with ID: SV22274
2026-03-28 05:01:14 [auto1.nl] INFO: Found listing with ID: HH25512
2026-03-28 05:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HH25512%27 HTTP/1.1" 200 None
2026-03-28 05:01:14 [auto1.nl] INFO: Scrape type for HH25512: 2
2026-03-28 05:01:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 505d56c1-b77f-5557-9f0c-fdca902b330a with identifier: HH25512
2026-03-28 05:01:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 505d56c1-b77f-5557-9f0c-fdca902b330a with scrape type 2
2026-03-28 05:01:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 505d56c1-b77f-5557-9f0c-fdca902b330a with scrape type 2
2026-03-28 05:01:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 505d56c1-b77f-5557-9f0c-fdca902b330a, identifier: HH25512
2026-03-28 05:01:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 505d56c1-b77f-5557-9f0c-fdca902b330a with identifier: HH25512
2026-03-28 05:01:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 505d56c1-b77f-5557-9f0c-fdca902b330a with identifier: HH25512
2026-03-28 05:01:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 505d56c1-b77f-5557-9f0c-fdca902b330a with identifier: HH25512 to the API
2026-03-28 05:01:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:01:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:01:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 85,
 'expiration_date': '2026-03-28T16:51:25Z',
 'fuel_type': 'petrol',
 'id': '505d56c1-b77f-5557-9f0c-fdca902b330a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HH25512',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Fabia',
 'odometer': 248607,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-05-22',
 'seller_name': None,
 'title': 'Skoda Fabia 1.2 TSI Style',
 'transmission': 'manual',
 'trim': 'Style',
 'year': 2011}
2026-03-28 05:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HH25512%27 HTTP/1.1" 200 None
2026-03-28 05:01:15 [auto1.nl] INFO: Saving data for HH25512: {'auction_closing_time': 1774716685.0, 'created_time': 1774465404.656484, 'last_price_update_time': 1774674075.391515}
2026-03-28 05:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='HH25512') HTTP/1.1" 204 0
2026-03-28 05:01:15 [auto1.nl] INFO: Found listing with ID: LH67432
2026-03-28 05:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LH67432%27 HTTP/1.1" 200 None
2026-03-28 05:01:15 [auto1.nl] INFO: Scrape type for LH67432: 0
2026-03-28 05:01:15 [auto1.nl] INFO: Found listing with ID: FD33602
2026-03-28 05:01:15 [auto1.nl] INFO: Found listing with ID: UP56929
2026-03-28 05:01:15 [auto1.nl] INFO: Found listing with ID: TK93788
2026-03-28 05:01:15 [auto1.nl] INFO: Found listing with ID: TW17403
2026-03-28 05:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TW17403%27 HTTP/1.1" 200 None
2026-03-28 05:01:15 [auto1.nl] INFO: Scrape type for TW17403: 0
2026-03-28 05:01:15 [auto1.nl] INFO: Found listing with ID: UT96124
2026-03-28 05:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UT96124%27 HTTP/1.1" 200 None
2026-03-28 05:01:15 [auto1.nl] INFO: Scrape type for UT96124: 0
2026-03-28 05:01:15 [auto1.nl] INFO: Found listing with ID: BZ75535
2026-03-28 05:01:15 [auto1.nl] INFO: Found listing with ID: XD61678
2026-03-28 05:01:15 [auto1.nl] INFO: Found listing with ID: NX58095
2026-03-28 05:01:15 [auto1.nl] INFO: Found listing with ID: XA55617
2026-03-28 05:01:15 [auto1.nl] INFO: Found listing with ID: BH47891
2026-03-28 05:01:15 [auto1.nl] INFO: Found listing with ID: WG23592
2026-03-28 05:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WG23592%27 HTTP/1.1" 200 None
2026-03-28 05:01:15 [auto1.nl] INFO: Scrape type for WG23592: 2
2026-03-28 05:01:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fade089d-2f35-5b63-9364-9ed30bc58ba8 with identifier: WG23592
2026-03-28 05:01:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fade089d-2f35-5b63-9364-9ed30bc58ba8 with scrape type 2
2026-03-28 05:01:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fade089d-2f35-5b63-9364-9ed30bc58ba8 with scrape type 2
2026-03-28 05:01:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: fade089d-2f35-5b63-9364-9ed30bc58ba8, identifier: WG23592
2026-03-28 05:01:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: fade089d-2f35-5b63-9364-9ed30bc58ba8 with identifier: WG23592
2026-03-28 05:01:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: fade089d-2f35-5b63-9364-9ed30bc58ba8 with identifier: WG23592
2026-03-28 05:01:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: fade089d-2f35-5b63-9364-9ed30bc58ba8 with identifier: WG23592 to the API
2026-03-28 05:01:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:01:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:01:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-28T16:13:40Z',
 'fuel_type': 'petrol',
 'id': 'fade089d-2f35-5b63-9364-9ed30bc58ba8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WG23592',
 'listing': 'auction',
 'make': 'MINI',
 'model': 'Countryman',
 'odometer': 112812,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-04-11',
 'seller_name': None,
 'title': 'MINI Countryman Cooper',
 'transmission': 'automatic',
 'trim': '',
 'year': 2012}
2026-03-28 05:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WG23592%27 HTTP/1.1" 200 None
2026-03-28 05:01:16 [auto1.nl] INFO: Saving data for WG23592: {'auction_closing_time': 1774714420.0, 'created_time': 1774465423.251805, 'last_price_update_time': 1774674076.81037}
2026-03-28 05:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='WG23592') HTTP/1.1" 204 0
2026-03-28 05:01:16 [auto1.nl] INFO: Found listing with ID: KP98004
2026-03-28 05:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KP98004%27 HTTP/1.1" 200 None
2026-03-28 05:01:16 [auto1.nl] INFO: Scrape type for KP98004: 0
2026-03-28 05:01:16 [auto1.nl] INFO: Found listing with ID: ST98483
2026-03-28 05:01:16 [auto1.nl] INFO: Found listing with ID: XY00413
2026-03-28 05:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XY00413%27 HTTP/1.1" 200 None
2026-03-28 05:01:16 [auto1.nl] INFO: Scrape type for XY00413: 0
2026-03-28 05:01:16 [auto1.nl] INFO: Found listing with ID: ZV50646
2026-03-28 05:01:16 [auto1.nl] INFO: Found listing with ID: FL22944
2026-03-28 05:01:16 [auto1.nl] INFO: Found listing with ID: SY25778
2026-03-28 05:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SY25778%27 HTTP/1.1" 200 None
2026-03-28 05:01:16 [auto1.nl] INFO: Scrape type for SY25778: 0
2026-03-28 05:01:16 [auto1.nl] INFO: Found listing with ID: BM96536
2026-03-28 05:01:16 [auto1.nl] INFO: Found listing with ID: WZ30415
2026-03-28 05:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WZ30415%27 HTTP/1.1" 200 None
2026-03-28 05:01:17 [auto1.nl] INFO: Scrape type for WZ30415: 0
2026-03-28 05:01:17 [auto1.nl] INFO: Found listing with ID: ZP53707
2026-03-28 05:01:17 [auto1.nl] INFO: Found listing with ID: LD78562
2026-03-28 05:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LD78562%27 HTTP/1.1" 200 None
2026-03-28 05:01:17 [auto1.nl] INFO: Scrape type for LD78562: 0
2026-03-28 05:01:17 [auto1.nl] INFO: Found listing with ID: VC90690
2026-03-28 05:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VC90690%27 HTTP/1.1" 200 None
2026-03-28 05:01:17 [auto1.nl] INFO: Scrape type for VC90690: 0
2026-03-28 05:01:17 [auto1.nl] INFO: Found listing with ID: TT16898
2026-03-28 05:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TT16898%27 HTTP/1.1" 200 None
2026-03-28 05:01:17 [auto1.nl] INFO: Scrape type for TT16898: 0
2026-03-28 05:01:17 [auto1.nl] INFO: Found listing with ID: DS66279
2026-03-28 05:01:17 [auto1.nl] INFO: Found listing with ID: RS83136
2026-03-28 05:01:17 [auto1.nl] INFO: Found listing with ID: BD37870
2026-03-28 05:01:17 [auto1.nl] INFO: Found listing with ID: PK22988
2026-03-28 05:01:17 [auto1.nl] INFO: Found listing with ID: HL29308
2026-03-28 05:01:17 [auto1.nl] INFO: Found listing with ID: DG66253
2026-03-28 05:01:17 [auto1.nl] INFO: Found listing with ID: WL71666
2026-03-28 05:01:17 [auto1.nl] INFO: Found listing with ID: KT83574
2026-03-28 05:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KT83574%27 HTTP/1.1" 200 None
2026-03-28 05:01:17 [auto1.nl] INFO: Scrape type for KT83574: 2
2026-03-28 05:01:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 037a3880-ba89-561f-8ece-492210c6d64c with identifier: KT83574
2026-03-28 05:01:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 037a3880-ba89-561f-8ece-492210c6d64c with scrape type 2
2026-03-28 05:01:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 037a3880-ba89-561f-8ece-492210c6d64c with scrape type 2
2026-03-28 05:01:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 037a3880-ba89-561f-8ece-492210c6d64c, identifier: KT83574
2026-03-28 05:01:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 037a3880-ba89-561f-8ece-492210c6d64c with identifier: KT83574
2026-03-28 05:01:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 05:01:17 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=red HTTP/1.1" 200 None
2026-03-28 05:01:17 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 05:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 05:01:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 037a3880-ba89-561f-8ece-492210c6d64c with identifier: KT83574
2026-03-28 05:01:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 037a3880-ba89-561f-8ece-492210c6d64c with identifier: KT83574 to the API
2026-03-28 05:01:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:01:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:01:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-28T16:16:21Z',
 'fuel_type': 'petrol',
 'id': '037a3880-ba89-561f-8ece-492210c6d64c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KT83574',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Corsa',
 'odometer': 271443,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-03-18',
 'seller_name': None,
 'title': 'Opel Corsa 1.4 Cosmo',
 'transmission': 'manual',
 'trim': 'Cosmo',
 'year': 2007}
2026-03-28 05:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KT83574%27 HTTP/1.1" 200 None
2026-03-28 05:01:18 [auto1.nl] INFO: Saving data for KT83574: {'auction_closing_time': 1774714581.0, 'created_time': 1774465395.108099, 'last_price_update_time': 1774674078.349874}
2026-03-28 05:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='KT83574') HTTP/1.1" 204 0
2026-03-28 05:01:19 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:01:19 [auto1.nl] INFO: Channel: 24h | Page: 8 | totalHits: 917 | hits on page: 40
2026-03-28 05:01:19 [auto1.nl] INFO: Found listing with ID: BG13282
2026-03-28 05:01:19 [auto1.nl] INFO: Found listing with ID: AT24375
2026-03-28 05:01:19 [auto1.nl] INFO: Found listing with ID: MK53801
2026-03-28 05:01:19 [auto1.nl] INFO: Found listing with ID: BB94394
2026-03-28 05:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BB94394%27 HTTP/1.1" 200 None
2026-03-28 05:01:19 [auto1.nl] INFO: Scrape type for BB94394: 0
2026-03-28 05:01:19 [auto1.nl] INFO: Found listing with ID: SV01425
2026-03-28 05:01:19 [auto1.nl] INFO: Found listing with ID: RX96199
2026-03-28 05:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RX96199%27 HTTP/1.1" 200 None
2026-03-28 05:01:19 [auto1.nl] INFO: Scrape type for RX96199: 0
2026-03-28 05:01:19 [auto1.nl] INFO: Found listing with ID: NN10776
2026-03-28 05:01:19 [auto1.nl] INFO: Found listing with ID: AZ90827
2026-03-28 05:01:19 [auto1.nl] INFO: Found listing with ID: VG54194
2026-03-28 05:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VG54194%27 HTTP/1.1" 200 None
2026-03-28 05:01:19 [auto1.nl] INFO: Scrape type for VG54194: 0
2026-03-28 05:01:19 [auto1.nl] INFO: Found listing with ID: PD16289
2026-03-28 05:01:19 [auto1.nl] INFO: Found listing with ID: TV23834
2026-03-28 05:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TV23834%27 HTTP/1.1" 200 None
2026-03-28 05:01:19 [auto1.nl] INFO: Scrape type for TV23834: 2
2026-03-28 05:01:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c013f964-af42-58c2-8f86-ae76de3af4c5 with identifier: TV23834
2026-03-28 05:01:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c013f964-af42-58c2-8f86-ae76de3af4c5 with scrape type 2
2026-03-28 05:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c013f964-af42-58c2-8f86-ae76de3af4c5 with scrape type 2
2026-03-28 05:01:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: c013f964-af42-58c2-8f86-ae76de3af4c5, identifier: TV23834
2026-03-28 05:01:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: c013f964-af42-58c2-8f86-ae76de3af4c5 with identifier: TV23834
2026-03-28 05:01:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: c013f964-af42-58c2-8f86-ae76de3af4c5 with identifier: TV23834
2026-03-28 05:01:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: c013f964-af42-58c2-8f86-ae76de3af4c5 with identifier: TV23834 to the API
2026-03-28 05:01:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:01:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:01:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 279,
 'expiration_date': '2026-03-28T16:11:24Z',
 'fuel_type': 'hybrid',
 'id': 'c013f964-af42-58c2-8f86-ae76de3af4c5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TV23834',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 185626,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-03-14',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 350e T Avantgarde',
 'transmission': 'automatic',
 'trim': 'T Avantgarde',
 'year': 2016}
2026-03-28 05:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TV23834%27 HTTP/1.1" 200 None
2026-03-28 05:01:20 [auto1.nl] INFO: Saving data for TV23834: {'auction_closing_time': 1774714284.0, 'created_time': 1774465398.264593, 'last_price_update_time': 1774674080.798814}
2026-03-28 05:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='TV23834') HTTP/1.1" 204 0
2026-03-28 05:01:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:01:20 [auto1.nl] INFO: Found listing with ID: UA44354
2026-03-28 05:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UA44354%27 HTTP/1.1" 200 None
2026-03-28 05:01:20 [auto1.nl] INFO: Scrape type for UA44354: 0
2026-03-28 05:01:20 [auto1.nl] INFO: Found listing with ID: EX49205
2026-03-28 05:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EX49205%27 HTTP/1.1" 200 None
2026-03-28 05:01:20 [auto1.nl] INFO: Scrape type for EX49205: 0
2026-03-28 05:01:20 [auto1.nl] INFO: Found listing with ID: YT16121
2026-03-28 05:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YT16121%27 HTTP/1.1" 200 None
2026-03-28 05:01:21 [auto1.nl] INFO: Scrape type for YT16121: 0
2026-03-28 05:01:21 [auto1.nl] INFO: Found listing with ID: AN01630
2026-03-28 05:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AN01630%27 HTTP/1.1" 200 None
2026-03-28 05:01:21 [auto1.nl] INFO: Scrape type for AN01630: 2
2026-03-28 05:01:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 110738ea-0629-5372-860b-098128426386 with identifier: AN01630
2026-03-28 05:01:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 110738ea-0629-5372-860b-098128426386 with scrape type 2
2026-03-28 05:01:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 110738ea-0629-5372-860b-098128426386 with scrape type 2
2026-03-28 05:01:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 110738ea-0629-5372-860b-098128426386, identifier: AN01630
2026-03-28 05:01:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 110738ea-0629-5372-860b-098128426386 with identifier: AN01630
2026-03-28 05:01:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 110738ea-0629-5372-860b-098128426386 with identifier: AN01630
2026-03-28 05:01:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 110738ea-0629-5372-860b-098128426386 with identifier: AN01630 to the API
2026-03-28 05:01:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:01:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:01:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-28T16:42:36Z',
 'fuel_type': 'petrol',
 'id': '110738ea-0629-5372-860b-098128426386',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AN01630',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Clio',
 'odometer': 157316,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-01-21',
 'seller_name': None,
 'title': 'Renault Clio 0.9 Energy Limited',
 'transmission': 'manual',
 'trim': 'Limited',
 'year': 2016}
2026-03-28 05:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AN01630%27 HTTP/1.1" 200 None
2026-03-28 05:01:21 [auto1.nl] INFO: Saving data for AN01630: {'auction_closing_time': 1774716156.0, 'created_time': 1774465412.399796, 'last_price_update_time': 1774674081.486662}
2026-03-28 05:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='AN01630') HTTP/1.1" 204 0
2026-03-28 05:01:21 [auto1.nl] INFO: Found listing with ID: AK38952
2026-03-28 05:01:21 [auto1.nl] INFO: Found listing with ID: FR87941
2026-03-28 05:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FR87941%27 HTTP/1.1" 200 None
2026-03-28 05:01:21 [auto1.nl] INFO: Scrape type for FR87941: 0
2026-03-28 05:01:21 [auto1.nl] INFO: Found listing with ID: EH82816
2026-03-28 05:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EH82816%27 HTTP/1.1" 200 None
2026-03-28 05:01:21 [auto1.nl] INFO: Scrape type for EH82816: 0
2026-03-28 05:01:21 [auto1.nl] INFO: Found listing with ID: JR94083
2026-03-28 05:01:21 [auto1.nl] INFO: Found listing with ID: GN78419
2026-03-28 05:01:21 [auto1.nl] INFO: Found listing with ID: BF56002
2026-03-28 05:01:21 [auto1.nl] INFO: Found listing with ID: UJ17437
2026-03-28 05:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UJ17437%27 HTTP/1.1" 200 None
2026-03-28 05:01:21 [auto1.nl] INFO: Scrape type for UJ17437: 0
2026-03-28 05:01:21 [auto1.nl] INFO: Found listing with ID: YK98733
2026-03-28 05:01:21 [auto1.nl] INFO: Found listing with ID: JN62257
2026-03-28 05:01:21 [auto1.nl] INFO: Found listing with ID: PU28768
2026-03-28 05:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PU28768%27 HTTP/1.1" 200 None
2026-03-28 05:01:21 [auto1.nl] INFO: Scrape type for PU28768: 0
2026-03-28 05:01:21 [auto1.nl] INFO: Found listing with ID: RX80263
2026-03-28 05:01:21 [auto1.nl] INFO: Found listing with ID: GH52378
2026-03-28 05:01:21 [auto1.nl] INFO: Found listing with ID: YZ87592
2026-03-28 05:01:21 [auto1.nl] INFO: Found listing with ID: RC67109
2026-03-28 05:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RC67109%27 HTTP/1.1" 200 None
2026-03-28 05:01:21 [auto1.nl] INFO: Scrape type for RC67109: 0
2026-03-28 05:01:21 [auto1.nl] INFO: Found listing with ID: TG63476
2026-03-28 05:01:21 [auto1.nl] INFO: Found listing with ID: HW48392
2026-03-28 05:01:21 [auto1.nl] INFO: Found listing with ID: WJ55319
2026-03-28 05:01:21 [auto1.nl] INFO: Found listing with ID: MF68511
2026-03-28 05:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MF68511%27 HTTP/1.1" 200 None
2026-03-28 05:01:21 [auto1.nl] INFO: Scrape type for MF68511: 0
2026-03-28 05:01:21 [auto1.nl] INFO: Found listing with ID: NA29712
2026-03-28 05:01:21 [auto1.nl] INFO: Found listing with ID: TG85730
2026-03-28 05:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TG85730%27 HTTP/1.1" 200 None
2026-03-28 05:01:21 [auto1.nl] INFO: Scrape type for TG85730: 2
2026-03-28 05:01:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ffb70a47-bd90-571b-a488-73a0d7ea4f98 with identifier: TG85730
2026-03-28 05:01:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ffb70a47-bd90-571b-a488-73a0d7ea4f98 with scrape type 2
2026-03-28 05:01:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ffb70a47-bd90-571b-a488-73a0d7ea4f98 with scrape type 2
2026-03-28 05:01:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: ffb70a47-bd90-571b-a488-73a0d7ea4f98, identifier: TG85730
2026-03-28 05:01:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: ffb70a47-bd90-571b-a488-73a0d7ea4f98 with identifier: TG85730
2026-03-28 05:01:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: ffb70a47-bd90-571b-a488-73a0d7ea4f98 with identifier: TG85730
2026-03-28 05:01:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: ffb70a47-bd90-571b-a488-73a0d7ea4f98 with identifier: TG85730 to the API
2026-03-28 05:01:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:01:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:01:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-28T16:13:02Z',
 'fuel_type': 'petrol',
 'id': 'ffb70a47-bd90-571b-a488-73a0d7ea4f98',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TG85730',
 'listing': 'auction',
 'make': 'Alfa Romeo',
 'model': 'MiTo',
 'odometer': 185553,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-07-14',
 'seller_name': None,
 'title': 'Alfa Romeo MiTo 0.9 TwinAir Turismo',
 'transmission': 'manual',
 'trim': 'Turismo',
 'year': 2014}
2026-03-28 05:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TG85730%27 HTTP/1.1" 200 None
2026-03-28 05:01:22 [auto1.nl] INFO: Saving data for TG85730: {'auction_closing_time': 1774714382.0, 'created_time': 1774465387.140445, 'last_price_update_time': 1774674082.919331}
2026-03-28 05:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='TG85730') HTTP/1.1" 204 0
2026-03-28 05:01:23 [auto1.nl] INFO: Found listing with ID: FC33520
2026-03-28 05:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FC33520%27 HTTP/1.1" 200 None
2026-03-28 05:01:23 [auto1.nl] INFO: Scrape type for FC33520: 0
2026-03-28 05:01:23 [auto1.nl] INFO: Found listing with ID: RL27027
2026-03-28 05:01:23 [auto1.nl] INFO: Found listing with ID: GV74945
2026-03-28 05:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GV74945%27 HTTP/1.1" 200 None
2026-03-28 05:01:23 [auto1.nl] INFO: Scrape type for GV74945: 0
2026-03-28 05:01:23 [auto1.nl] INFO: Found listing with ID: GY41852
2026-03-28 05:01:23 [auto1.nl] INFO: Found listing with ID: YF67230
2026-03-28 05:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YF67230%27 HTTP/1.1" 200 None
2026-03-28 05:01:23 [auto1.nl] INFO: Scrape type for YF67230: 0
2026-03-28 05:01:24 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:01:24 [auto1.nl] INFO: Channel: 24h | Page: 9 | totalHits: 917 | hits on page: 40
2026-03-28 05:01:24 [auto1.nl] INFO: Found listing with ID: UC11957
2026-03-28 05:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UC11957%27 HTTP/1.1" 200 None
2026-03-28 05:01:24 [auto1.nl] INFO: Scrape type for UC11957: 0
2026-03-28 05:01:24 [auto1.nl] INFO: Found listing with ID: LF56220
2026-03-28 05:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LF56220%27 HTTP/1.1" 200 None
2026-03-28 05:01:24 [auto1.nl] INFO: Scrape type for LF56220: 0
2026-03-28 05:01:24 [auto1.nl] INFO: Found listing with ID: WG43530
2026-03-28 05:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WG43530%27 HTTP/1.1" 200 None
2026-03-28 05:01:24 [auto1.nl] INFO: Scrape type for WG43530: 2
2026-03-28 05:01:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6a763deb-91c2-53a0-b308-90429aaf94df with identifier: WG43530
2026-03-28 05:01:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6a763deb-91c2-53a0-b308-90429aaf94df with scrape type 2
2026-03-28 05:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6a763deb-91c2-53a0-b308-90429aaf94df with scrape type 2
2026-03-28 05:01:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 6a763deb-91c2-53a0-b308-90429aaf94df, identifier: WG43530
2026-03-28 05:01:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 6a763deb-91c2-53a0-b308-90429aaf94df with identifier: WG43530
2026-03-28 05:01:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 6a763deb-91c2-53a0-b308-90429aaf94df with identifier: WG43530
2026-03-28 05:01:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 6a763deb-91c2-53a0-b308-90429aaf94df with identifier: WG43530 to the API
2026-03-28 05:01:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:01:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:01:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 194,
 'expiration_date': '2026-03-28T16:15:30Z',
 'fuel_type': 'petrol',
 'id': '6a763deb-91c2-53a0-b308-90429aaf94df',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WG43530',
 'listing': 'auction',
 'make': 'Mazda',
 'model': 'CX-5',
 'odometer': 149122,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-06-19',
 'seller_name': None,
 'title': 'Mazda CX-5 2.5 SKYACTIV-G Takumi AWD',
 'transmission': 'automatic',
 'trim': 'Takumi AWD',
 'year': 2018}
2026-03-28 05:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WG43530%27 HTTP/1.1" 200 None
2026-03-28 05:01:24 [auto1.nl] INFO: Saving data for WG43530: {'auction_closing_time': 1774714530.0, 'created_time': 1774465344.870462, 'last_price_update_time': 1774674084.858564}
2026-03-28 05:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='WG43530') HTTP/1.1" 204 0
2026-03-28 05:01:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:01:24 [auto1.nl] INFO: Found listing with ID: CU35423
2026-03-28 05:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CU35423%27 HTTP/1.1" 200 None
2026-03-28 05:01:24 [auto1.nl] INFO: Scrape type for CU35423: 2
2026-03-28 05:01:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9282a218-25b8-5356-aade-50a8a0dde52e with identifier: CU35423
2026-03-28 05:01:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9282a218-25b8-5356-aade-50a8a0dde52e with scrape type 2
2026-03-28 05:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9282a218-25b8-5356-aade-50a8a0dde52e with scrape type 2
2026-03-28 05:01:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 9282a218-25b8-5356-aade-50a8a0dde52e, identifier: CU35423
2026-03-28 05:01:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 9282a218-25b8-5356-aade-50a8a0dde52e with identifier: CU35423
2026-03-28 05:01:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 9282a218-25b8-5356-aade-50a8a0dde52e with identifier: CU35423
2026-03-28 05:01:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 9282a218-25b8-5356-aade-50a8a0dde52e with identifier: CU35423 to the API
2026-03-28 05:01:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:01:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:01:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 163,
 'expiration_date': '2026-03-28T16:27:06Z',
 'fuel_type': 'diesel',
 'id': '9282a218-25b8-5356-aade-50a8a0dde52e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CU35423',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '308',
 'odometer': 106521,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-03-24',
 'seller_name': None,
 'title': 'Peugeot 308 2.0 HDi Allure',
 'transmission': 'automatic',
 'trim': 'Allure',
 'year': 2011}
2026-03-28 05:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CU35423%27 HTTP/1.1" 200 None
2026-03-28 05:01:25 [auto1.nl] INFO: Saving data for CU35423: {'auction_closing_time': 1774715226.0, 'created_time': 1774551744.548415, 'last_price_update_time': 1774674085.322162}
2026-03-28 05:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='CU35423') HTTP/1.1" 204 0
2026-03-28 05:01:25 [auto1.nl] INFO: Found listing with ID: HL15145
2026-03-28 05:01:25 [auto1.nl] INFO: Found listing with ID: UH74159
2026-03-28 05:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UH74159%27 HTTP/1.1" 200 None
2026-03-28 05:01:25 [auto1.nl] INFO: Scrape type for UH74159: 0
2026-03-28 05:01:25 [auto1.nl] INFO: Found listing with ID: JH65457
2026-03-28 05:01:25 [auto1.nl] INFO: Found listing with ID: NG59138
2026-03-28 05:01:25 [auto1.nl] INFO: Found listing with ID: DX60140
2026-03-28 05:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DX60140%27 HTTP/1.1" 200 None
2026-03-28 05:01:25 [auto1.nl] INFO: Scrape type for DX60140: 0
2026-03-28 05:01:25 [auto1.nl] INFO: Found listing with ID: CM82546
2026-03-28 05:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CM82546%27 HTTP/1.1" 200 None
2026-03-28 05:01:25 [auto1.nl] INFO: Scrape type for CM82546: 2
2026-03-28 05:01:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 133c9cb0-e881-5240-b8eb-788fa3c341b6 with identifier: CM82546
2026-03-28 05:01:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 133c9cb0-e881-5240-b8eb-788fa3c341b6 with scrape type 2
2026-03-28 05:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 133c9cb0-e881-5240-b8eb-788fa3c341b6 with scrape type 2
2026-03-28 05:01:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 133c9cb0-e881-5240-b8eb-788fa3c341b6, identifier: CM82546
2026-03-28 05:01:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 133c9cb0-e881-5240-b8eb-788fa3c341b6 with identifier: CM82546
2026-03-28 05:01:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 133c9cb0-e881-5240-b8eb-788fa3c341b6 with identifier: CM82546
2026-03-28 05:01:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 133c9cb0-e881-5240-b8eb-788fa3c341b6 with identifier: CM82546 to the API
2026-03-28 05:01:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:01:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:01:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 218,
 'expiration_date': '2026-03-28T16:39:48Z',
 'fuel_type': 'petrol',
 'id': '133c9cb0-e881-5240-b8eb-788fa3c341b6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CM82546',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 230495,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2006-03-06',
 'seller_name': None,
 'title': 'BMW 3er 325i xDrive',
 'transmission': 'automatic',
 'trim': 'xDrive',
 'year': 2006}
2026-03-28 05:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CM82546%27 HTTP/1.1" 200 None
2026-03-28 05:01:25 [auto1.nl] INFO: Saving data for CM82546: {'auction_closing_time': 1774715988.0, 'created_time': 1774551704.471483, 'last_price_update_time': 1774674085.852177}
2026-03-28 05:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='CM82546') HTTP/1.1" 204 0
2026-03-28 05:01:25 [auto1.nl] INFO: Found listing with ID: RX87837
2026-03-28 05:01:25 [auto1.nl] INFO: Found listing with ID: CD92062
2026-03-28 05:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CD92062%27 HTTP/1.1" 200 None
2026-03-28 05:01:25 [auto1.nl] INFO: Scrape type for CD92062: 0
2026-03-28 05:01:25 [auto1.nl] INFO: Found listing with ID: KZ09082
2026-03-28 05:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KZ09082%27 HTTP/1.1" 200 None
2026-03-28 05:01:25 [auto1.nl] INFO: Scrape type for KZ09082: 2
2026-03-28 05:01:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 04bb139e-4ba8-5b53-8e2a-f325bcea1619 with identifier: KZ09082
2026-03-28 05:01:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 04bb139e-4ba8-5b53-8e2a-f325bcea1619 with scrape type 2
2026-03-28 05:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 04bb139e-4ba8-5b53-8e2a-f325bcea1619 with scrape type 2
2026-03-28 05:01:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 04bb139e-4ba8-5b53-8e2a-f325bcea1619, identifier: KZ09082
2026-03-28 05:01:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 04bb139e-4ba8-5b53-8e2a-f325bcea1619 with identifier: KZ09082
2026-03-28 05:01:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 04bb139e-4ba8-5b53-8e2a-f325bcea1619 with identifier: KZ09082
2026-03-28 05:01:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 04bb139e-4ba8-5b53-8e2a-f325bcea1619 with identifier: KZ09082 to the API
2026-03-28 05:01:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:01:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:01:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-28T16:54:28Z',
 'fuel_type': 'petrol',
 'id': '04bb139e-4ba8-5b53-8e2a-f325bcea1619',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KZ09082',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Astra',
 'odometer': 196832,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-03-29',
 'seller_name': None,
 'title': 'Opel Astra 1.0 Turbo ON Start/Stop',
 'transmission': 'manual',
 'trim': 'ON Start/Stop',
 'year': 2018}
2026-03-28 05:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KZ09082%27 HTTP/1.1" 200 None
2026-03-28 05:01:26 [auto1.nl] INFO: Saving data for KZ09082: {'auction_closing_time': 1774716868.0, 'created_time': 1774551743.047535, 'last_price_update_time': 1774674086.442049}
2026-03-28 05:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='KZ09082') HTTP/1.1" 204 0
2026-03-28 05:01:26 [auto1.nl] INFO: Found listing with ID: EK38089
2026-03-28 05:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EK38089%27 HTTP/1.1" 200 None
2026-03-28 05:01:26 [auto1.nl] INFO: Scrape type for EK38089: 2
2026-03-28 05:01:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 45020602-a651-5b28-9158-191f691320fe with identifier: EK38089
2026-03-28 05:01:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 45020602-a651-5b28-9158-191f691320fe with scrape type 2
2026-03-28 05:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 45020602-a651-5b28-9158-191f691320fe with scrape type 2
2026-03-28 05:01:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 45020602-a651-5b28-9158-191f691320fe, identifier: EK38089
2026-03-28 05:01:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 45020602-a651-5b28-9158-191f691320fe with identifier: EK38089
2026-03-28 05:01:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 45020602-a651-5b28-9158-191f691320fe with identifier: EK38089
2026-03-28 05:01:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 45020602-a651-5b28-9158-191f691320fe with identifier: EK38089 to the API
2026-03-28 05:01:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:01:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:01:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 340,
 'expiration_date': '2026-03-28T16:30:10Z',
 'fuel_type': 'petrol',
 'id': '45020602-a651-5b28-9158-191f691320fe',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EK38089',
 'listing': 'auction',
 'make': 'BMW',
 'model': '6er',
 'odometer': 179285,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-01-11',
 'seller_name': None,
 'title': 'BMW 6er 640i GT xDrive M Sport',
 'transmission': 'automatic',
 'trim': 'xDrive M Sport',
 'year': 2018}
2026-03-28 05:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EK38089%27 HTTP/1.1" 200 None
2026-03-28 05:01:26 [auto1.nl] INFO: Saving data for EK38089: {'auction_closing_time': 1774715410.0, 'created_time': 1774551723.723329, 'last_price_update_time': 1774674086.980367}
2026-03-28 05:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='EK38089') HTTP/1.1" 204 0
2026-03-28 05:01:27 [auto1.nl] INFO: Found listing with ID: MX82019
2026-03-28 05:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MX82019%27 HTTP/1.1" 200 None
2026-03-28 05:01:27 [auto1.nl] INFO: Scrape type for MX82019: 2
2026-03-28 05:01:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f88ee384-b91f-5b59-a7d9-8d318cb9e052 with identifier: MX82019
2026-03-28 05:01:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f88ee384-b91f-5b59-a7d9-8d318cb9e052 with scrape type 2
2026-03-28 05:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f88ee384-b91f-5b59-a7d9-8d318cb9e052 with scrape type 2
2026-03-28 05:01:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: f88ee384-b91f-5b59-a7d9-8d318cb9e052, identifier: MX82019
2026-03-28 05:01:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: f88ee384-b91f-5b59-a7d9-8d318cb9e052 with identifier: MX82019
2026-03-28 05:01:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: f88ee384-b91f-5b59-a7d9-8d318cb9e052 with identifier: MX82019
2026-03-28 05:01:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: f88ee384-b91f-5b59-a7d9-8d318cb9e052 with identifier: MX82019 to the API
2026-03-28 05:01:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:01:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:01:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 103,
 'expiration_date': '2026-03-28T16:31:19Z',
 'fuel_type': 'petrol',
 'id': 'f88ee384-b91f-5b59-a7d9-8d318cb9e052',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MX82019',
 'listing': 'auction',
 'make': 'Lancia',
 'model': 'Delta',
 'odometer': 214768,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '1999-08-26',
 'seller_name': None,
 'title': 'Lancia Delta 1.6 HPE',
 'transmission': 'manual',
 'trim': 'HPE',
 'year': 1999}
2026-03-28 05:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MX82019%27 HTTP/1.1" 200 None
2026-03-28 05:01:27 [auto1.nl] INFO: Saving data for MX82019: {'auction_closing_time': 1774715479.0, 'created_time': 1774551749.529035, 'last_price_update_time': 1774674087.477266}
2026-03-28 05:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='MX82019') HTTP/1.1" 204 0
2026-03-28 05:01:27 [auto1.nl] INFO: Found listing with ID: DY48945
2026-03-28 05:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DY48945%27 HTTP/1.1" 200 None
2026-03-28 05:01:27 [auto1.nl] INFO: Scrape type for DY48945: 0
2026-03-28 05:01:27 [auto1.nl] INFO: Found listing with ID: DG73581
2026-03-28 05:01:27 [auto1.nl] INFO: Found listing with ID: JS13271
2026-03-28 05:01:27 [auto1.nl] INFO: Found listing with ID: GM40908
2026-03-28 05:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GM40908%27 HTTP/1.1" 200 None
2026-03-28 05:01:27 [auto1.nl] INFO: Scrape type for GM40908: 0
2026-03-28 05:01:27 [auto1.nl] INFO: Found listing with ID: NB25760
2026-03-28 05:01:27 [auto1.nl] INFO: Found listing with ID: FP10265
2026-03-28 05:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FP10265%27 HTTP/1.1" 200 None
2026-03-28 05:01:27 [auto1.nl] INFO: Scrape type for FP10265: 2
2026-03-28 05:01:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 02ecd506-7c44-5c1c-acff-874e7fe5348e with identifier: FP10265
2026-03-28 05:01:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 02ecd506-7c44-5c1c-acff-874e7fe5348e with scrape type 2
2026-03-28 05:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 02ecd506-7c44-5c1c-acff-874e7fe5348e with scrape type 2
2026-03-28 05:01:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 02ecd506-7c44-5c1c-acff-874e7fe5348e, identifier: FP10265
2026-03-28 05:01:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 02ecd506-7c44-5c1c-acff-874e7fe5348e with identifier: FP10265
2026-03-28 05:01:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 02ecd506-7c44-5c1c-acff-874e7fe5348e with identifier: FP10265
2026-03-28 05:01:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 02ecd506-7c44-5c1c-acff-874e7fe5348e with identifier: FP10265 to the API
2026-03-28 05:01:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:01:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:01:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-28T16:50:21Z',
 'fuel_type': 'petrol',
 'id': '02ecd506-7c44-5c1c-acff-874e7fe5348e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FP10265',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'CLA-Klasse',
 'odometer': 140399,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-04-27',
 'seller_name': None,
 'title': 'Mercedes-Benz CLA-Klasse CLA 180 Shooting Brake AMG Line',
 'transmission': 'automatic',
 'trim': 'AMG Line',
 'year': 2015}
2026-03-28 05:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FP10265%27 HTTP/1.1" 200 None
2026-03-28 05:01:27 [auto1.nl] INFO: Saving data for FP10265: {'auction_closing_time': 1774716621.0, 'created_time': 1774551686.012455, 'last_price_update_time': 1774674087.974199}
2026-03-28 05:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='FP10265') HTTP/1.1" 204 0
2026-03-28 05:01:28 [auto1.nl] INFO: Found listing with ID: TE69449
2026-03-28 05:01:28 [auto1.nl] INFO: Found listing with ID: PW38124
2026-03-28 05:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PW38124%27 HTTP/1.1" 200 None
2026-03-28 05:01:28 [auto1.nl] INFO: Scrape type for PW38124: 0
2026-03-28 05:01:28 [auto1.nl] INFO: Found listing with ID: HS40359
2026-03-28 05:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HS40359%27 HTTP/1.1" 200 None
2026-03-28 05:01:28 [auto1.nl] INFO: Scrape type for HS40359: 2
2026-03-28 05:01:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8ab09278-e469-595e-bf43-42f8fb56ee8a with identifier: HS40359
2026-03-28 05:01:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8ab09278-e469-595e-bf43-42f8fb56ee8a with scrape type 2
2026-03-28 05:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8ab09278-e469-595e-bf43-42f8fb56ee8a with scrape type 2
2026-03-28 05:01:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 8ab09278-e469-595e-bf43-42f8fb56ee8a, identifier: HS40359
2026-03-28 05:01:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 8ab09278-e469-595e-bf43-42f8fb56ee8a with identifier: HS40359
2026-03-28 05:01:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 8ab09278-e469-595e-bf43-42f8fb56ee8a with identifier: HS40359
2026-03-28 05:01:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 8ab09278-e469-595e-bf43-42f8fb56ee8a with identifier: HS40359 to the API
2026-03-28 05:01:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:01:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:01:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 85,
 'expiration_date': '2026-03-28T16:36:13Z',
 'fuel_type': 'petrol',
 'id': '8ab09278-e469-595e-bf43-42f8fb56ee8a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HS40359',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VI',
 'odometer': 144498,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-12-08',
 'seller_name': None,
 'title': 'Volkswagen Golf VI 1.2 TSI Trendline',
 'transmission': 'manual',
 'trim': 'Trendline',
 'year': 2010}
2026-03-28 05:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HS40359%27 HTTP/1.1" 200 None
2026-03-28 05:01:28 [auto1.nl] INFO: Saving data for HS40359: {'auction_closing_time': 1774715773.0, 'created_time': 1774465386.378716, 'last_price_update_time': 1774674088.6123}
2026-03-28 05:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='HS40359') HTTP/1.1" 204 0
2026-03-28 05:01:28 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:01:28 [auto1.nl] INFO: Found listing with ID: RT82599
2026-03-28 05:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RT82599%27 HTTP/1.1" 200 None
2026-03-28 05:01:28 [auto1.nl] INFO: Scrape type for RT82599: 0
2026-03-28 05:01:28 [auto1.nl] INFO: Found listing with ID: DB77408
2026-03-28 05:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DB77408%27 HTTP/1.1" 200 None
2026-03-28 05:01:28 [auto1.nl] INFO: Scrape type for DB77408: 2
2026-03-28 05:01:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 07e82b59-733b-5ee7-9d02-86ab330ec4bb with identifier: DB77408
2026-03-28 05:01:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 07e82b59-733b-5ee7-9d02-86ab330ec4bb with scrape type 2
2026-03-28 05:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 07e82b59-733b-5ee7-9d02-86ab330ec4bb with scrape type 2
2026-03-28 05:01:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 07e82b59-733b-5ee7-9d02-86ab330ec4bb, identifier: DB77408
2026-03-28 05:01:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 07e82b59-733b-5ee7-9d02-86ab330ec4bb with identifier: DB77408
2026-03-28 05:01:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 07e82b59-733b-5ee7-9d02-86ab330ec4bb with identifier: DB77408
2026-03-28 05:01:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 07e82b59-733b-5ee7-9d02-86ab330ec4bb with identifier: DB77408 to the API
2026-03-28 05:01:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:01:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:01:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:13:23Z',
 'fuel_type': 'petrol',
 'id': '07e82b59-733b-5ee7-9d02-86ab330ec4bb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DB77408',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Kodiaq',
 'odometer': 196473,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-07-25',
 'seller_name': None,
 'title': 'Skoda Kodiaq 1.5 TSI ACT Style',
 'transmission': 'automatic',
 'trim': 'Style',
 'year': 2019}
2026-03-28 05:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DB77408%27 HTTP/1.1" 200 None
2026-03-28 05:01:29 [auto1.nl] INFO: Saving data for DB77408: {'auction_closing_time': 1774714403.0, 'created_time': 1774465390.142385, 'last_price_update_time': 1774674089.094497}
2026-03-28 05:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='DB77408') HTTP/1.1" 204 0
2026-03-28 05:01:29 [auto1.nl] INFO: Found listing with ID: ME98271
2026-03-28 05:01:29 [auto1.nl] INFO: Found listing with ID: DF87411
2026-03-28 05:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DF87411%27 HTTP/1.1" 200 None
2026-03-28 05:01:29 [auto1.nl] INFO: Scrape type for DF87411: 0
2026-03-28 05:01:29 [auto1.nl] INFO: Found listing with ID: YR08683
2026-03-28 05:01:29 [auto1.nl] INFO: Found listing with ID: KK56723
2026-03-28 05:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KK56723%27 HTTP/1.1" 200 None
2026-03-28 05:01:29 [auto1.nl] INFO: Scrape type for KK56723: 0
2026-03-28 05:01:29 [auto1.nl] INFO: Found listing with ID: JJ43979
2026-03-28 05:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JJ43979%27 HTTP/1.1" 200 None
2026-03-28 05:01:29 [auto1.nl] INFO: Scrape type for JJ43979: 2
2026-03-28 05:01:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 436c3c49-e4d7-5b01-bb46-9a7d209cdeb5 with identifier: JJ43979
2026-03-28 05:01:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 436c3c49-e4d7-5b01-bb46-9a7d209cdeb5 with scrape type 2
2026-03-28 05:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 436c3c49-e4d7-5b01-bb46-9a7d209cdeb5 with scrape type 2
2026-03-28 05:01:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 436c3c49-e4d7-5b01-bb46-9a7d209cdeb5, identifier: JJ43979
2026-03-28 05:01:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 436c3c49-e4d7-5b01-bb46-9a7d209cdeb5 with identifier: JJ43979
2026-03-28 05:01:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 436c3c49-e4d7-5b01-bb46-9a7d209cdeb5 with identifier: JJ43979
2026-03-28 05:01:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 436c3c49-e4d7-5b01-bb46-9a7d209cdeb5 with identifier: JJ43979 to the API
2026-03-28 05:01:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:01:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:01:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 286,
 'expiration_date': '2026-03-28T16:34:35Z',
 'fuel_type': 'hybrid',
 'id': '436c3c49-e4d7-5b01-bb46-9a7d209cdeb5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JJ43979',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'E-Klasse',
 'odometer': 200307,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-12-29',
 'seller_name': None,
 'title': 'Mercedes-Benz E-Klasse E 350e Avantgarde',
 'transmission': 'automatic',
 'trim': 'Avantgarde',
 'year': 2016}
2026-03-28 05:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JJ43979%27 HTTP/1.1" 200 None
2026-03-28 05:01:29 [auto1.nl] INFO: Saving data for JJ43979: {'auction_closing_time': 1774715675.0, 'created_time': 1774465269.420552, 'last_price_update_time': 1774674089.653517}
2026-03-28 05:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='JJ43979') HTTP/1.1" 204 0
2026-03-28 05:01:29 [auto1.nl] INFO: Channel: 24h | Page: 10 | totalHits: 917 | hits on page: 40
2026-03-28 05:01:29 [auto1.nl] INFO: Found listing with ID: DF82688
2026-03-28 05:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DF82688%27 HTTP/1.1" 200 None
2026-03-28 05:01:29 [auto1.nl] INFO: Scrape type for DF82688: 0
2026-03-28 05:01:29 [auto1.nl] INFO: Found listing with ID: LH74130
2026-03-28 05:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LH74130%27 HTTP/1.1" 200 None
2026-03-28 05:01:29 [auto1.nl] INFO: Scrape type for LH74130: 2
2026-03-28 05:01:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 40625265-3030-59d9-b02b-12a5c557ee0d with identifier: LH74130
2026-03-28 05:01:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 40625265-3030-59d9-b02b-12a5c557ee0d with scrape type 2
2026-03-28 05:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 40625265-3030-59d9-b02b-12a5c557ee0d with scrape type 2
2026-03-28 05:01:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 40625265-3030-59d9-b02b-12a5c557ee0d, identifier: LH74130
2026-03-28 05:01:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 40625265-3030-59d9-b02b-12a5c557ee0d with identifier: LH74130
2026-03-28 05:01:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 40625265-3030-59d9-b02b-12a5c557ee0d with identifier: LH74130
2026-03-28 05:01:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 40625265-3030-59d9-b02b-12a5c557ee0d with identifier: LH74130 to the API
2026-03-28 05:01:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:01:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:01:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 163,
 'expiration_date': '2026-03-28T16:07:23Z',
 'fuel_type': 'petrol',
 'id': '40625265-3030-59d9-b02b-12a5c557ee0d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LH74130',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'CLK-Klasse',
 'odometer': 102470,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2005-03-31',
 'seller_name': None,
 'title': 'Mercedes-Benz CLK-Klasse CLK 200 Kompressor Avantgarde',
 'transmission': 'automatic',
 'trim': 'Avantgarde',
 'year': 2005}
2026-03-28 05:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LH74130%27 HTTP/1.1" 200 None
2026-03-28 05:01:30 [auto1.nl] INFO: Saving data for LH74130: {'auction_closing_time': 1774714043.0, 'created_time': 1774465321.251098, 'last_price_update_time': 1774674090.888615}
2026-03-28 05:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='LH74130') HTTP/1.1" 204 0
2026-03-28 05:01:31 [auto1.nl] INFO: Found listing with ID: PC64486
2026-03-28 05:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PC64486%27 HTTP/1.1" 200 None
2026-03-28 05:01:31 [auto1.nl] INFO: Scrape type for PC64486: 0
2026-03-28 05:01:31 [auto1.nl] INFO: Found listing with ID: PZ31508
2026-03-28 05:01:31 [auto1.nl] INFO: Found listing with ID: DN23343
2026-03-28 05:01:31 [auto1.nl] INFO: Found listing with ID: CP17463
2026-03-28 05:01:31 [auto1.nl] INFO: Found listing with ID: EJ39658
2026-03-28 05:01:31 [auto1.nl] INFO: Found listing with ID: AG27565
2026-03-28 05:01:31 [auto1.nl] INFO: Found listing with ID: TF74045
2026-03-28 05:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TF74045%27 HTTP/1.1" 200 None
2026-03-28 05:01:31 [auto1.nl] INFO: Scrape type for TF74045: 2
2026-03-28 05:01:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a1945aeb-843f-5a25-81bb-29e572cc3c51 with identifier: TF74045
2026-03-28 05:01:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a1945aeb-843f-5a25-81bb-29e572cc3c51 with scrape type 2
2026-03-28 05:01:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a1945aeb-843f-5a25-81bb-29e572cc3c51 with scrape type 2
2026-03-28 05:01:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: a1945aeb-843f-5a25-81bb-29e572cc3c51, identifier: TF74045
2026-03-28 05:01:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:01:31 [auto1.nl] INFO: Found listing with ID: BD28084
2026-03-28 05:01:31 [auto1.nl] INFO: Found listing with ID: DM34469
2026-03-28 05:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DM34469%27 HTTP/1.1" 200 None
2026-03-28 05:01:31 [auto1.nl] INFO: Scrape type for DM34469: 0
2026-03-28 05:01:31 [auto1.nl] INFO: Found listing with ID: LR97495
2026-03-28 05:01:31 [auto1.nl] INFO: Found listing with ID: KC58229
2026-03-28 05:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KC58229%27 HTTP/1.1" 200 None
2026-03-28 05:01:31 [auto1.nl] INFO: Scrape type for KC58229: 0
2026-03-28 05:01:31 [auto1.nl] INFO: Found listing with ID: VT81070
2026-03-28 05:01:31 [auto1.nl] INFO: Found listing with ID: AS78971
2026-03-28 05:01:31 [auto1.nl] INFO: Found listing with ID: TN86188
2026-03-28 05:01:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: a1945aeb-843f-5a25-81bb-29e572cc3c51 with identifier: TF74045
2026-03-28 05:01:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: a1945aeb-843f-5a25-81bb-29e572cc3c51 with identifier: TF74045
2026-03-28 05:01:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: a1945aeb-843f-5a25-81bb-29e572cc3c51 with identifier: TF74045 to the API
2026-03-28 05:01:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:01:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:01:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 313,
 'expiration_date': '2026-03-28T16:31:43Z',
 'fuel_type': 'hybrid',
 'id': 'a1945aeb-843f-5a25-81bb-29e572cc3c51',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TF74045',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 93131,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-12-21',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 300e T AMG Line',
 'transmission': 'automatic',
 'trim': 'T AMG Line',
 'year': 2022}
2026-03-28 05:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TF74045%27 HTTP/1.1" 200 None
2026-03-28 05:01:32 [auto1.nl] INFO: Saving data for TF74045: {'auction_closing_time': 1774715503.0, 'created_time': 1774465415.114591, 'last_price_update_time': 1774674092.229246}
2026-03-28 05:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='TF74045') HTTP/1.1" 204 0
2026-03-28 05:01:32 [auto1.nl] INFO: Found listing with ID: BW31181
2026-03-28 05:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BW31181%27 HTTP/1.1" 200 None
2026-03-28 05:01:32 [auto1.nl] INFO: Scrape type for BW31181: 0
2026-03-28 05:01:32 [auto1.nl] INFO: Found listing with ID: SX35832
2026-03-28 05:01:32 [auto1.nl] INFO: Found listing with ID: RF26708
2026-03-28 05:01:32 [auto1.nl] INFO: Found listing with ID: RV40948
2026-03-28 05:01:32 [auto1.nl] INFO: Found listing with ID: LN13615
2026-03-28 05:01:32 [auto1.nl] INFO: Found listing with ID: CV80682
2026-03-28 05:01:32 [auto1.nl] INFO: Found listing with ID: SL71745
2026-03-28 05:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SL71745%27 HTTP/1.1" 200 None
2026-03-28 05:01:32 [auto1.nl] INFO: Scrape type for SL71745: 2
2026-03-28 05:01:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3c22e07f-05c5-5f22-8ccf-3debf0280670 with identifier: SL71745
2026-03-28 05:01:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3c22e07f-05c5-5f22-8ccf-3debf0280670 with scrape type 2
2026-03-28 05:01:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3c22e07f-05c5-5f22-8ccf-3debf0280670 with scrape type 2
2026-03-28 05:01:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 3c22e07f-05c5-5f22-8ccf-3debf0280670, identifier: SL71745
2026-03-28 05:01:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 3c22e07f-05c5-5f22-8ccf-3debf0280670 with identifier: SL71745
2026-03-28 05:01:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 3c22e07f-05c5-5f22-8ccf-3debf0280670 with identifier: SL71745
2026-03-28 05:01:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 3c22e07f-05c5-5f22-8ccf-3debf0280670 with identifier: SL71745 to the API
2026-03-28 05:01:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:01:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:01:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-28T16:39:52Z',
 'fuel_type': 'petrol',
 'id': '3c22e07f-05c5-5f22-8ccf-3debf0280670',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SL71745',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Touran',
 'odometer': 152013,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-03-13',
 'seller_name': None,
 'title': 'Volkswagen Touran 1.2 TSI Comfortline BlueMotion',
 'transmission': 'manual',
 'trim': 'Comfortline BlueMotion',
 'year': 2011}
2026-03-28 05:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SL71745%27 HTTP/1.1" 200 None
2026-03-28 05:01:32 [auto1.nl] INFO: Saving data for SL71745: {'auction_closing_time': 1774715992.0, 'created_time': 1773229438.826716, 'last_price_update_time': 1774674092.974985}
2026-03-28 05:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='SL71745') HTTP/1.1" 204 0
2026-03-28 05:01:32 [auto1.nl] INFO: Found listing with ID: EP01312
2026-03-28 05:01:32 [auto1.nl] INFO: Found listing with ID: ZB66825
2026-03-28 05:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZB66825%27 HTTP/1.1" 200 None
2026-03-28 05:01:33 [auto1.nl] INFO: Scrape type for ZB66825: 2
2026-03-28 05:01:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7d5015a4-866a-52b4-bcc4-9f60141b03cc with identifier: ZB66825
2026-03-28 05:01:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7d5015a4-866a-52b4-bcc4-9f60141b03cc with scrape type 2
2026-03-28 05:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7d5015a4-866a-52b4-bcc4-9f60141b03cc with scrape type 2
2026-03-28 05:01:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 7d5015a4-866a-52b4-bcc4-9f60141b03cc, identifier: ZB66825
2026-03-28 05:01:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 7d5015a4-866a-52b4-bcc4-9f60141b03cc with identifier: ZB66825
2026-03-28 05:01:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 7d5015a4-866a-52b4-bcc4-9f60141b03cc with identifier: ZB66825
2026-03-28 05:01:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 7d5015a4-866a-52b4-bcc4-9f60141b03cc with identifier: ZB66825 to the API
2026-03-28 05:01:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:01:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:01:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 210,
 'expiration_date': '2026-03-28T16:26:15Z',
 'fuel_type': 'petrol',
 'id': '7d5015a4-866a-52b4-bcc4-9f60141b03cc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZB66825',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q5',
 'odometer': 239793,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-01-05',
 'seller_name': None,
 'title': 'Audi Q5 2.0 TFSI quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2012}
2026-03-28 05:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZB66825%27 HTTP/1.1" 200 None
2026-03-28 05:01:33 [auto1.nl] INFO: Saving data for ZB66825: {'auction_closing_time': 1774715175.0, 'created_time': 1774465392.882373, 'last_price_update_time': 1774674093.462864}
2026-03-28 05:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='ZB66825') HTTP/1.1" 204 0
2026-03-28 05:01:33 [auto1.nl] INFO: Found listing with ID: HU61188
2026-03-28 05:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HU61188%27 HTTP/1.1" 200 None
2026-03-28 05:01:33 [auto1.nl] INFO: Scrape type for HU61188: 0
2026-03-28 05:01:33 [auto1.nl] INFO: Found listing with ID: CR08212
2026-03-28 05:01:33 [auto1.nl] INFO: Found listing with ID: BD71761
2026-03-28 05:01:33 [auto1.nl] INFO: Found listing with ID: RD50492
2026-03-28 05:01:33 [auto1.nl] INFO: Found listing with ID: AV65488
2026-03-28 05:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AV65488%27 HTTP/1.1" 200 None
2026-03-28 05:01:33 [auto1.nl] INFO: Scrape type for AV65488: 2
2026-03-28 05:01:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 630c0a0e-5e25-5e4d-a3cd-2ab10f69d2a4 with identifier: AV65488
2026-03-28 05:01:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 630c0a0e-5e25-5e4d-a3cd-2ab10f69d2a4 with scrape type 2
2026-03-28 05:01:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 630c0a0e-5e25-5e4d-a3cd-2ab10f69d2a4 with scrape type 2
2026-03-28 05:01:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 630c0a0e-5e25-5e4d-a3cd-2ab10f69d2a4, identifier: AV65488
2026-03-28 05:01:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 630c0a0e-5e25-5e4d-a3cd-2ab10f69d2a4 with identifier: AV65488
2026-03-28 05:01:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 630c0a0e-5e25-5e4d-a3cd-2ab10f69d2a4 with identifier: AV65488
2026-03-28 05:01:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 630c0a0e-5e25-5e4d-a3cd-2ab10f69d2a4 with identifier: AV65488 to the API
2026-03-28 05:01:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:01:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:01:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'orange',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 80,
 'expiration_date': '2026-03-28T16:59:24Z',
 'fuel_type': 'petrol',
 'id': '630c0a0e-5e25-5e4d-a3cd-2ab10f69d2a4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AV65488',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 133986,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-03-22',
 'seller_name': None,
 'title': 'Volkswagen Polo 1.4 CrossPolo',
 'transmission': 'manual',
 'trim': 'Cross',
 'year': 2007}
2026-03-28 05:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AV65488%27 HTTP/1.1" 200 None
2026-03-28 05:01:33 [auto1.nl] INFO: Saving data for AV65488: {'auction_closing_time': 1774717164.0, 'created_time': 1773836939.124053, 'last_price_update_time': 1774674093.932029}
2026-03-28 05:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='AV65488') HTTP/1.1" 204 0
2026-03-28 05:01:34 [auto1.nl] INFO: Found listing with ID: HZ82321
2026-03-28 05:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HZ82321%27 HTTP/1.1" 200 None
2026-03-28 05:01:34 [auto1.nl] INFO: Scrape type for HZ82321: 0
2026-03-28 05:01:34 [auto1.nl] INFO: Found listing with ID: UU65627
2026-03-28 05:01:34 [auto1.nl] INFO: Found listing with ID: EC34005
2026-03-28 05:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EC34005%27 HTTP/1.1" 200 None
2026-03-28 05:01:34 [auto1.nl] INFO: Scrape type for EC34005: 0
2026-03-28 05:01:34 [auto1.nl] INFO: Found listing with ID: FA26024
2026-03-28 05:01:34 [auto1.nl] INFO: Found listing with ID: ZY88945
2026-03-28 05:01:34 [auto1.nl] INFO: Found listing with ID: GD46513
2026-03-28 05:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GD46513%27 HTTP/1.1" 200 None
2026-03-28 05:01:34 [auto1.nl] INFO: Scrape type for GD46513: 0
2026-03-28 05:01:34 [auto1.nl] INFO: Found listing with ID: FH88416
2026-03-28 05:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FH88416%27 HTTP/1.1" 200 None
2026-03-28 05:01:34 [auto1.nl] INFO: Scrape type for FH88416: 2
2026-03-28 05:01:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f2944f94-8a96-50e1-9b6c-ee20ed28183f with identifier: FH88416
2026-03-28 05:01:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f2944f94-8a96-50e1-9b6c-ee20ed28183f with scrape type 2
2026-03-28 05:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f2944f94-8a96-50e1-9b6c-ee20ed28183f with scrape type 2
2026-03-28 05:01:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: f2944f94-8a96-50e1-9b6c-ee20ed28183f, identifier: FH88416
2026-03-28 05:01:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: f2944f94-8a96-50e1-9b6c-ee20ed28183f with identifier: FH88416
2026-03-28 05:01:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: f2944f94-8a96-50e1-9b6c-ee20ed28183f with identifier: FH88416
2026-03-28 05:01:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: f2944f94-8a96-50e1-9b6c-ee20ed28183f with identifier: FH88416 to the API
2026-03-28 05:01:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:01:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:01:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-28T16:16:44Z',
 'fuel_type': 'petrol',
 'id': 'f2944f94-8a96-50e1-9b6c-ee20ed28183f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FH88416',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'A-Klasse',
 'odometer': 90728,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-07-18',
 'seller_name': None,
 'title': 'Mercedes-Benz A-Klasse A 180 Avantgarde',
 'transmission': 'manual',
 'trim': 'Avantgarde',
 'year': 2010}
2026-03-28 05:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FH88416%27 HTTP/1.1" 200 None
2026-03-28 05:01:34 [auto1.nl] INFO: Saving data for FH88416: {'auction_closing_time': 1774714604.0, 'created_time': 1774551761.859179, 'last_price_update_time': 1774674094.610882}
2026-03-28 05:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='FH88416') HTTP/1.1" 204 0
2026-03-28 05:01:34 [auto1.nl] INFO: Found listing with ID: BX68417
2026-03-28 05:01:34 [auto1.nl] INFO: Found listing with ID: JG11787
2026-03-28 05:01:34 [auto1.nl] INFO: Found listing with ID: LT61011
2026-03-28 05:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LT61011%27 HTTP/1.1" 200 None
2026-03-28 05:01:34 [auto1.nl] INFO: Scrape type for LT61011: 2
2026-03-28 05:01:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 895f6ddb-d43d-5cb7-acbc-65874857d224 with identifier: LT61011
2026-03-28 05:01:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 895f6ddb-d43d-5cb7-acbc-65874857d224 with scrape type 2
2026-03-28 05:01:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 895f6ddb-d43d-5cb7-acbc-65874857d224 with scrape type 2
2026-03-28 05:01:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 895f6ddb-d43d-5cb7-acbc-65874857d224, identifier: LT61011
2026-03-28 05:01:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 895f6ddb-d43d-5cb7-acbc-65874857d224 with identifier: LT61011
2026-03-28 05:01:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 895f6ddb-d43d-5cb7-acbc-65874857d224 with identifier: LT61011
2026-03-28 05:01:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 895f6ddb-d43d-5cb7-acbc-65874857d224 with identifier: LT61011 to the API
2026-03-28 05:01:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:01:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:01:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 80,
 'expiration_date': '2026-03-28T16:30:42Z',
 'fuel_type': 'diesel',
 'id': '895f6ddb-d43d-5cb7-acbc-65874857d224',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LT61011',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'Citan',
 'odometer': 77777,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-11-01',
 'seller_name': None,
 'title': 'Mercedes-Benz Citan 108 CDI lang',
 'transmission': 'manual',
 'trim': 'lang',
 'year': 2020}
2026-03-28 05:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LT61011%27 HTTP/1.1" 200 None
2026-03-28 05:01:35 [auto1.nl] INFO: Saving data for LT61011: {'auction_closing_time': 1774715442.0, 'created_time': 1774551751.131415, 'last_price_update_time': 1774674095.192726}
2026-03-28 05:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='LT61011') HTTP/1.1" 204 0
2026-03-28 05:01:35 [auto1.nl] INFO: Found listing with ID: NY95005
2026-03-28 05:01:35 [auto1.nl] INFO: Found listing with ID: PL46145
2026-03-28 05:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PL46145%27 HTTP/1.1" 200 None
2026-03-28 05:01:35 [auto1.nl] INFO: Scrape type for PL46145: 0
2026-03-28 05:01:35 [auto1.nl] INFO: Found listing with ID: YD79188
2026-03-28 05:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YD79188%27 HTTP/1.1" 200 None
2026-03-28 05:01:35 [auto1.nl] INFO: Scrape type for YD79188: 0
2026-03-28 05:01:35 [auto1.nl] INFO: Found listing with ID: FD12318
2026-03-28 05:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FD12318%27 HTTP/1.1" 200 None
2026-03-28 05:01:35 [auto1.nl] INFO: Scrape type for FD12318: 0
2026-03-28 05:01:35 [auto1.nl] INFO: Found listing with ID: JA24721
2026-03-28 05:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JA24721%27 HTTP/1.1" 200 None
2026-03-28 05:01:35 [auto1.nl] INFO: Scrape type for JA24721: 0
2026-03-28 05:01:35 [auto1.nl] INFO: Found listing with ID: LT65669
2026-03-28 05:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LT65669%27 HTTP/1.1" 200 None
2026-03-28 05:01:35 [auto1.nl] INFO: Scrape type for LT65669: 0
2026-03-28 05:01:35 [auto1.nl] INFO: Found listing with ID: EM66057
2026-03-28 05:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EM66057%27 HTTP/1.1" 200 None
2026-03-28 05:01:35 [auto1.nl] INFO: Scrape type for EM66057: 0
2026-03-28 05:01:35 [auto1.nl] INFO: Found listing with ID: AL58798
2026-03-28 05:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AL58798%27 HTTP/1.1" 200 None
2026-03-28 05:01:35 [auto1.nl] INFO: Scrape type for AL58798: 2
2026-03-28 05:01:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f49cdd50-8a02-5464-ab8b-7b6f4312a0f2 with identifier: AL58798
2026-03-28 05:01:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f49cdd50-8a02-5464-ab8b-7b6f4312a0f2 with scrape type 2
2026-03-28 05:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f49cdd50-8a02-5464-ab8b-7b6f4312a0f2 with scrape type 2
2026-03-28 05:01:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: f49cdd50-8a02-5464-ab8b-7b6f4312a0f2, identifier: AL58798
2026-03-28 05:01:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: f49cdd50-8a02-5464-ab8b-7b6f4312a0f2 with identifier: AL58798
2026-03-28 05:01:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: f49cdd50-8a02-5464-ab8b-7b6f4312a0f2 with identifier: AL58798
2026-03-28 05:01:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: f49cdd50-8a02-5464-ab8b-7b6f4312a0f2 with identifier: AL58798 to the API
2026-03-28 05:01:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:01:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:01:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 160,
 'expiration_date': '2026-03-28T16:39:01Z',
 'fuel_type': 'petrol',
 'id': 'f49cdd50-8a02-5464-ab8b-7b6f4312a0f2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AL58798',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf Plus',
 'odometer': 138869,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-01-07',
 'seller_name': None,
 'title': 'Volkswagen Golf Plus 1.4 TSI CrossGolf',
 'transmission': 'automatic',
 'trim': 'CrossGolf',
 'year': 2009}
2026-03-28 05:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AL58798%27 HTTP/1.1" 200 None
2026-03-28 05:01:35 [auto1.nl] INFO: Saving data for AL58798: {'auction_closing_time': 1774715941.0, 'created_time': 1774551706.712607, 'last_price_update_time': 1774674095.780217}
2026-03-28 05:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='AL58798') HTTP/1.1" 204 0
2026-03-28 05:01:35 [auto1.nl] INFO: Found listing with ID: RG26073
2026-03-28 05:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RG26073%27 HTTP/1.1" 200 None
2026-03-28 05:01:35 [auto1.nl] INFO: Scrape type for RG26073: 0
2026-03-28 05:01:35 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:01:36 [auto1.nl] INFO: Channel: 24h | Page: 11 | totalHits: 917 | hits on page: 40
2026-03-28 05:01:36 [auto1.nl] INFO: Found listing with ID: BY33770
2026-03-28 05:01:36 [auto1.nl] INFO: Found listing with ID: MP21910
2026-03-28 05:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MP21910%27 HTTP/1.1" 200 None
2026-03-28 05:01:36 [auto1.nl] INFO: Scrape type for MP21910: 0
2026-03-28 05:01:36 [auto1.nl] INFO: Found listing with ID: HV97203
2026-03-28 05:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HV97203%27 HTTP/1.1" 200 None
2026-03-28 05:01:36 [auto1.nl] INFO: Scrape type for HV97203: 0
2026-03-28 05:01:36 [auto1.nl] INFO: Found listing with ID: RT17278
2026-03-28 05:01:36 [auto1.nl] INFO: Found listing with ID: YE36776
2026-03-28 05:01:36 [auto1.nl] INFO: Found listing with ID: TE70578
2026-03-28 05:01:36 [auto1.nl] INFO: Found listing with ID: CT01963
2026-03-28 05:01:36 [auto1.nl] INFO: Found listing with ID: EM54492
2026-03-28 05:01:36 [auto1.nl] INFO: Found listing with ID: RW09535
2026-03-28 05:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RW09535%27 HTTP/1.1" 200 None
2026-03-28 05:01:36 [auto1.nl] INFO: Scrape type for RW09535: 2
2026-03-28 05:01:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ddc4fc64-35a8-5500-90ea-8dcf35817f24 with identifier: RW09535
2026-03-28 05:01:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ddc4fc64-35a8-5500-90ea-8dcf35817f24 with scrape type 2
2026-03-28 05:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ddc4fc64-35a8-5500-90ea-8dcf35817f24 with scrape type 2
2026-03-28 05:01:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: ddc4fc64-35a8-5500-90ea-8dcf35817f24, identifier: RW09535
2026-03-28 05:01:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: ddc4fc64-35a8-5500-90ea-8dcf35817f24 with identifier: RW09535
2026-03-28 05:01:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: ddc4fc64-35a8-5500-90ea-8dcf35817f24 with identifier: RW09535
2026-03-28 05:01:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: ddc4fc64-35a8-5500-90ea-8dcf35817f24 with identifier: RW09535 to the API
2026-03-28 05:01:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:01:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:01:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-28T16:43:44Z',
 'fuel_type': 'petrol',
 'id': 'ddc4fc64-35a8-5500-90ea-8dcf35817f24',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RW09535',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 158989,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-07-25',
 'seller_name': None,
 'title': 'Ford Focus 1.0 EcoBoost Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2016}
2026-03-28 05:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RW09535%27 HTTP/1.1" 200 None
2026-03-28 05:01:36 [auto1.nl] INFO: Saving data for RW09535: {'auction_closing_time': 1774716224.0, 'created_time': 1774465386.063832, 'last_price_update_time': 1774674096.547577}
2026-03-28 05:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='RW09535') HTTP/1.1" 204 0
2026-03-28 05:01:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:01:36 [auto1.nl] INFO: Found listing with ID: CF65603
2026-03-28 05:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CF65603%27 HTTP/1.1" 200 None
2026-03-28 05:01:36 [auto1.nl] INFO: Scrape type for CF65603: 2
2026-03-28 05:01:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6324a6d6-438e-50e6-a90d-82c21e38832e with identifier: CF65603
2026-03-28 05:01:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6324a6d6-438e-50e6-a90d-82c21e38832e with scrape type 2
2026-03-28 05:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6324a6d6-438e-50e6-a90d-82c21e38832e with scrape type 2
2026-03-28 05:01:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 6324a6d6-438e-50e6-a90d-82c21e38832e, identifier: CF65603
2026-03-28 05:01:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 6324a6d6-438e-50e6-a90d-82c21e38832e with identifier: CF65603
2026-03-28 05:01:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 6324a6d6-438e-50e6-a90d-82c21e38832e with identifier: CF65603
2026-03-28 05:01:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 6324a6d6-438e-50e6-a90d-82c21e38832e with identifier: CF65603 to the API
2026-03-28 05:01:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:01:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:01:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 245,
 'expiration_date': '2026-03-28T16:46:48Z',
 'fuel_type': 'hybrid',
 'id': '6324a6d6-438e-50e6-a90d-82c21e38832e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CF65603',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Octavia',
 'odometer': 193306,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-07-07',
 'seller_name': None,
 'title': 'Skoda Octavia 1.4 TSI iV RS',
 'transmission': 'automatic',
 'trim': 'RS',
 'year': 2021}
2026-03-28 05:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CF65603%27 HTTP/1.1" 200 None
2026-03-28 05:01:37 [auto1.nl] INFO: Saving data for CF65603: {'auction_closing_time': 1774716408.0, 'created_time': 1774551739.185534, 'last_price_update_time': 1774674097.07222}
2026-03-28 05:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='CF65603') HTTP/1.1" 204 0
2026-03-28 05:01:37 [auto1.nl] INFO: Found listing with ID: TS92650
2026-03-28 05:01:37 [auto1.nl] INFO: Found listing with ID: ZN91004
2026-03-28 05:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZN91004%27 HTTP/1.1" 200 None
2026-03-28 05:01:37 [auto1.nl] INFO: Scrape type for ZN91004: 0
2026-03-28 05:01:37 [auto1.nl] INFO: Found listing with ID: XZ67857
2026-03-28 05:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XZ67857%27 HTTP/1.1" 200 None
2026-03-28 05:01:37 [auto1.nl] INFO: Scrape type for XZ67857: 0
2026-03-28 05:01:37 [auto1.nl] INFO: Found listing with ID: YW78376
2026-03-28 05:01:37 [auto1.nl] INFO: Found listing with ID: HB74565
2026-03-28 05:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HB74565%27 HTTP/1.1" 200 None
2026-03-28 05:01:37 [auto1.nl] INFO: Scrape type for HB74565: 0
2026-03-28 05:01:37 [auto1.nl] INFO: Found listing with ID: SW41282
2026-03-28 05:01:37 [auto1.nl] INFO: Found listing with ID: XJ86601
2026-03-28 05:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XJ86601%27 HTTP/1.1" 200 None
2026-03-28 05:01:37 [auto1.nl] INFO: Scrape type for XJ86601: 0
2026-03-28 05:01:37 [auto1.nl] INFO: Found listing with ID: PZ22600
2026-03-28 05:01:37 [auto1.nl] INFO: Found listing with ID: TV26065
2026-03-28 05:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TV26065%27 HTTP/1.1" 200 None
2026-03-28 05:01:37 [auto1.nl] INFO: Scrape type for TV26065: 2
2026-03-28 05:01:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4a2b6c6f-1d48-5186-8693-8ed3bae21dd8 with identifier: TV26065
2026-03-28 05:01:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4a2b6c6f-1d48-5186-8693-8ed3bae21dd8 with scrape type 2
2026-03-28 05:01:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4a2b6c6f-1d48-5186-8693-8ed3bae21dd8 with scrape type 2
2026-03-28 05:01:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 4a2b6c6f-1d48-5186-8693-8ed3bae21dd8, identifier: TV26065
2026-03-28 05:01:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 4a2b6c6f-1d48-5186-8693-8ed3bae21dd8 with identifier: TV26065
2026-03-28 05:01:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 4a2b6c6f-1d48-5186-8693-8ed3bae21dd8 with identifier: TV26065
2026-03-28 05:01:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 4a2b6c6f-1d48-5186-8693-8ed3bae21dd8 with identifier: TV26065 to the API
2026-03-28 05:01:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:01:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:01:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-28T16:52:46Z',
 'fuel_type': 'petrol',
 'id': '4a2b6c6f-1d48-5186-8693-8ed3bae21dd8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TV26065',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 125812,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-07-29',
 'seller_name': None,
 'title': 'Ford Focus 1.0 EcoBoost Easy',
 'transmission': 'manual',
 'trim': 'Easy',
 'year': 2014}
2026-03-28 05:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TV26065%27 HTTP/1.1" 200 None
2026-03-28 05:01:37 [auto1.nl] INFO: Saving data for TV26065: {'auction_closing_time': 1774716766.0, 'created_time': 1774465405.353382, 'last_price_update_time': 1774674097.746318}
2026-03-28 05:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='TV26065') HTTP/1.1" 204 0
2026-03-28 05:01:37 [auto1.nl] INFO: Found listing with ID: BN28689
2026-03-28 05:01:37 [auto1.nl] INFO: Found listing with ID: MD57319
2026-03-28 05:01:37 [auto1.nl] INFO: Found listing with ID: GB93242
2026-03-28 05:01:37 [auto1.nl] INFO: Found listing with ID: AX29422
2026-03-28 05:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AX29422%27 HTTP/1.1" 200 None
2026-03-28 05:01:37 [auto1.nl] INFO: Scrape type for AX29422: 0
2026-03-28 05:01:37 [auto1.nl] INFO: Found listing with ID: WP75740
2026-03-28 05:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WP75740%27 HTTP/1.1" 200 None
2026-03-28 05:01:37 [auto1.nl] INFO: Scrape type for WP75740: 0
2026-03-28 05:01:37 [auto1.nl] INFO: Found listing with ID: CK48888
2026-03-28 05:01:37 [auto1.nl] INFO: Found listing with ID: JT64166
2026-03-28 05:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JT64166%27 HTTP/1.1" 200 None
2026-03-28 05:01:37 [auto1.nl] INFO: Scrape type for JT64166: 0
2026-03-28 05:01:37 [auto1.nl] INFO: Found listing with ID: ZK25360
2026-03-28 05:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZK25360%27 HTTP/1.1" 200 None
2026-03-28 05:01:37 [auto1.nl] INFO: Scrape type for ZK25360: 2
2026-03-28 05:01:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d22f8407-1f61-5a92-9cec-3474818de27e with identifier: ZK25360
2026-03-28 05:01:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d22f8407-1f61-5a92-9cec-3474818de27e with scrape type 2
2026-03-28 05:01:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d22f8407-1f61-5a92-9cec-3474818de27e with scrape type 2
2026-03-28 05:01:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: d22f8407-1f61-5a92-9cec-3474818de27e, identifier: ZK25360
2026-03-28 05:01:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: d22f8407-1f61-5a92-9cec-3474818de27e with identifier: ZK25360
2026-03-28 05:01:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: d22f8407-1f61-5a92-9cec-3474818de27e with identifier: ZK25360
2026-03-28 05:01:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: d22f8407-1f61-5a92-9cec-3474818de27e with identifier: ZK25360 to the API
2026-03-28 05:01:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:01:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:01:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:20:54Z',
 'fuel_type': 'petrol',
 'id': 'd22f8407-1f61-5a92-9cec-3474818de27e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZK25360',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 254537,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-08-23',
 'seller_name': None,
 'title': 'Ford Focus 1.6 EcoBoost Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2011}
2026-03-28 05:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZK25360%27 HTTP/1.1" 200 None
2026-03-28 05:01:38 [auto1.nl] INFO: Saving data for ZK25360: {'auction_closing_time': 1774714854.0, 'created_time': 1773229380.796057, 'last_price_update_time': 1774674098.294379}
2026-03-28 05:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='ZK25360') HTTP/1.1" 204 0
2026-03-28 05:01:38 [auto1.nl] INFO: Found listing with ID: GD99184
2026-03-28 05:01:38 [auto1.nl] INFO: Found listing with ID: PY50820
2026-03-28 05:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PY50820%27 HTTP/1.1" 200 None
2026-03-28 05:01:38 [auto1.nl] INFO: Scrape type for PY50820: 2
2026-03-28 05:01:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: acf92713-ab07-5644-a46f-ff781cdc5926 with identifier: PY50820
2026-03-28 05:01:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item acf92713-ab07-5644-a46f-ff781cdc5926 with scrape type 2
2026-03-28 05:01:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item acf92713-ab07-5644-a46f-ff781cdc5926 with scrape type 2
2026-03-28 05:01:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: acf92713-ab07-5644-a46f-ff781cdc5926, identifier: PY50820
2026-03-28 05:01:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: acf92713-ab07-5644-a46f-ff781cdc5926 with identifier: PY50820
2026-03-28 05:01:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: acf92713-ab07-5644-a46f-ff781cdc5926 with identifier: PY50820
2026-03-28 05:01:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: acf92713-ab07-5644-a46f-ff781cdc5926 with identifier: PY50820 to the API
2026-03-28 05:01:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:01:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:01:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:49:16Z',
 'fuel_type': 'petrol',
 'id': 'acf92713-ab07-5644-a46f-ff781cdc5926',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PY50820',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Octavia',
 'odometer': 197757,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-07-11',
 'seller_name': None,
 'title': 'Skoda Octavia 1.4 TSI Style',
 'transmission': 'manual',
 'trim': 'Style',
 'year': 2016}
2026-03-28 05:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PY50820%27 HTTP/1.1" 200 None
2026-03-28 05:01:38 [auto1.nl] INFO: Saving data for PY50820: {'auction_closing_time': 1774716556.0, 'created_time': 1774551764.59255, 'last_price_update_time': 1774674098.938673}
2026-03-28 05:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='PY50820') HTTP/1.1" 204 0
2026-03-28 05:01:38 [auto1.nl] INFO: Found listing with ID: WV32142
2026-03-28 05:01:38 [auto1.nl] INFO: Found listing with ID: LW98869
2026-03-28 05:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LW98869%27 HTTP/1.1" 200 None
2026-03-28 05:01:38 [auto1.nl] INFO: Scrape type for LW98869: 0
2026-03-28 05:01:38 [auto1.nl] INFO: Found listing with ID: DU88284
2026-03-28 05:01:38 [auto1.nl] INFO: Found listing with ID: WC97739
2026-03-28 05:01:38 [auto1.nl] INFO: Found listing with ID: MC21923
2026-03-28 05:01:38 [auto1.nl] INFO: Found listing with ID: ZL38920
2026-03-28 05:01:38 [auto1.nl] INFO: Found listing with ID: AK82229
2026-03-28 05:01:38 [auto1.nl] INFO: Found listing with ID: FD16016
2026-03-28 05:01:38 [auto1.nl] INFO: Found listing with ID: NX54730
2026-03-28 05:01:38 [auto1.nl] INFO: Found listing with ID: HZ22754
2026-03-28 05:01:38 [auto1.nl] INFO: Found listing with ID: FC55354
2026-03-28 05:01:39 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:01:40 [auto1.nl] INFO: Channel: 24h | Page: 12 | totalHits: 917 | hits on page: 40
2026-03-28 05:01:40 [auto1.nl] INFO: Found listing with ID: LA08041
2026-03-28 05:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LA08041%27 HTTP/1.1" 200 None
2026-03-28 05:01:40 [auto1.nl] INFO: Scrape type for LA08041: 0
2026-03-28 05:01:40 [auto1.nl] INFO: Found listing with ID: UU92567
2026-03-28 05:01:40 [auto1.nl] INFO: Found listing with ID: XY67301
2026-03-28 05:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XY67301%27 HTTP/1.1" 200 None
2026-03-28 05:01:40 [auto1.nl] INFO: Scrape type for XY67301: 0
2026-03-28 05:01:40 [auto1.nl] INFO: Found listing with ID: SD69435
2026-03-28 05:01:40 [auto1.nl] INFO: Found listing with ID: LD75991
2026-03-28 05:01:40 [auto1.nl] INFO: Found listing with ID: CL54405
2026-03-28 05:01:40 [auto1.nl] INFO: Found listing with ID: CJ31369
2026-03-28 05:01:40 [auto1.nl] INFO: Found listing with ID: WV84251
2026-03-28 05:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WV84251%27 HTTP/1.1" 200 None
2026-03-28 05:01:40 [auto1.nl] INFO: Scrape type for WV84251: 0
2026-03-28 05:01:40 [auto1.nl] INFO: Found listing with ID: MD55137
2026-03-28 05:01:40 [auto1.nl] INFO: Found listing with ID: HT85176
2026-03-28 05:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HT85176%27 HTTP/1.1" 200 None
2026-03-28 05:01:40 [auto1.nl] INFO: Scrape type for HT85176: 0
2026-03-28 05:01:40 [auto1.nl] INFO: Found listing with ID: AY73779
2026-03-28 05:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AY73779%27 HTTP/1.1" 200 None
2026-03-28 05:01:40 [auto1.nl] INFO: Scrape type for AY73779: 0
2026-03-28 05:01:40 [auto1.nl] INFO: Found listing with ID: ZE21436
2026-03-28 05:01:40 [auto1.nl] INFO: Found listing with ID: TU57635
2026-03-28 05:01:40 [auto1.nl] INFO: Found listing with ID: PZ30163
2026-03-28 05:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PZ30163%27 HTTP/1.1" 200 None
2026-03-28 05:01:40 [auto1.nl] INFO: Scrape type for PZ30163: 0
2026-03-28 05:01:40 [auto1.nl] INFO: Found listing with ID: TL32110
2026-03-28 05:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TL32110%27 HTTP/1.1" 200 None
2026-03-28 05:01:40 [auto1.nl] INFO: Scrape type for TL32110: 0
2026-03-28 05:01:40 [auto1.nl] INFO: Found listing with ID: LJ77908
2026-03-28 05:01:40 [auto1.nl] INFO: Found listing with ID: GS89780
2026-03-28 05:01:40 [auto1.nl] INFO: Found listing with ID: VA86988
2026-03-28 05:01:40 [auto1.nl] INFO: Found listing with ID: DS12539
2026-03-28 05:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DS12539%27 HTTP/1.1" 200 None
2026-03-28 05:01:40 [auto1.nl] INFO: Scrape type for DS12539: 0
2026-03-28 05:01:40 [auto1.nl] INFO: Found listing with ID: XF65643
2026-03-28 05:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XF65643%27 HTTP/1.1" 200 None
2026-03-28 05:01:40 [auto1.nl] INFO: Scrape type for XF65643: 2
2026-03-28 05:01:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5737d744-d8b1-52f3-b943-0f6745baa910 with identifier: XF65643
2026-03-28 05:01:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5737d744-d8b1-52f3-b943-0f6745baa910 with scrape type 2
2026-03-28 05:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5737d744-d8b1-52f3-b943-0f6745baa910 with scrape type 2
2026-03-28 05:01:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 5737d744-d8b1-52f3-b943-0f6745baa910, identifier: XF65643
2026-03-28 05:01:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 5737d744-d8b1-52f3-b943-0f6745baa910 with identifier: XF65643
2026-03-28 05:01:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 5737d744-d8b1-52f3-b943-0f6745baa910 with identifier: XF65643
2026-03-28 05:01:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 5737d744-d8b1-52f3-b943-0f6745baa910 with identifier: XF65643 to the API
2026-03-28 05:01:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:01:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:01:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 68,
 'expiration_date': '2026-03-28T16:35:20Z',
 'fuel_type': 'petrol',
 'id': '5737d744-d8b1-52f3-b943-0f6745baa910',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XF65643',
 'listing': 'auction',
 'make': 'Chevrolet',
 'model': 'Spark',
 'odometer': 94162,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-09-05',
 'seller_name': None,
 'title': 'Chevrolet Spark 1.0 LS',
 'transmission': 'manual',
 'trim': 'LS',
 'year': 2010}
2026-03-28 05:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XF65643%27 HTTP/1.1" 200 None
2026-03-28 05:01:40 [auto1.nl] INFO: Saving data for XF65643: {'auction_closing_time': 1774715720.0, 'created_time': 1774465382.285143, 'last_price_update_time': 1774674100.653066}
2026-03-28 05:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='XF65643') HTTP/1.1" 204 0
2026-03-28 05:01:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:01:40 [auto1.nl] INFO: Found listing with ID: JF28004
2026-03-28 05:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JF28004%27 HTTP/1.1" 200 None
2026-03-28 05:01:40 [auto1.nl] INFO: Scrape type for JF28004: 0
2026-03-28 05:01:40 [auto1.nl] INFO: Found listing with ID: UE20026
2026-03-28 05:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UE20026%27 HTTP/1.1" 200 None
2026-03-28 05:01:40 [auto1.nl] INFO: Scrape type for UE20026: 2
2026-03-28 05:01:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 66af6efa-be37-5d7b-a8bb-f94290f1336c with identifier: UE20026
2026-03-28 05:01:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 66af6efa-be37-5d7b-a8bb-f94290f1336c with scrape type 2
2026-03-28 05:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 66af6efa-be37-5d7b-a8bb-f94290f1336c with scrape type 2
2026-03-28 05:01:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 66af6efa-be37-5d7b-a8bb-f94290f1336c, identifier: UE20026
2026-03-28 05:01:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 66af6efa-be37-5d7b-a8bb-f94290f1336c with identifier: UE20026
2026-03-28 05:01:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 66af6efa-be37-5d7b-a8bb-f94290f1336c with identifier: UE20026
2026-03-28 05:01:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 66af6efa-be37-5d7b-a8bb-f94290f1336c with identifier: UE20026 to the API
2026-03-28 05:01:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:01:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:01:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-28T16:49:50Z',
 'fuel_type': 'petrol',
 'id': '66af6efa-be37-5d7b-a8bb-f94290f1336c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UE20026',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 127602,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-06-07',
 'seller_name': None,
 'title': 'BMW 3er 320i Sport Line',
 'transmission': 'automatic',
 'trim': 'Sport Line',
 'year': 2017}
2026-03-28 05:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UE20026%27 HTTP/1.1" 200 None
2026-03-28 05:01:41 [auto1.nl] INFO: Saving data for UE20026: {'auction_closing_time': 1774716590.0, 'created_time': 1774465380.802893, 'last_price_update_time': 1774674101.248766}
2026-03-28 05:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='UE20026') HTTP/1.1" 204 0
2026-03-28 05:01:41 [auto1.nl] INFO: Found listing with ID: XD32446
2026-03-28 05:01:41 [auto1.nl] INFO: Found listing with ID: XB72700
2026-03-28 05:01:41 [auto1.nl] INFO: Found listing with ID: FZ55104
2026-03-28 05:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FZ55104%27 HTTP/1.1" 200 None
2026-03-28 05:01:41 [auto1.nl] INFO: Scrape type for FZ55104: 0
2026-03-28 05:01:41 [auto1.nl] INFO: Found listing with ID: AX44669
2026-03-28 05:01:41 [auto1.nl] INFO: Found listing with ID: LF83736
2026-03-28 05:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LF83736%27 HTTP/1.1" 200 None
2026-03-28 05:01:41 [auto1.nl] INFO: Scrape type for LF83736: 0
2026-03-28 05:01:41 [auto1.nl] INFO: Found listing with ID: XV41758
2026-03-28 05:01:41 [auto1.nl] INFO: Found listing with ID: VL80205
2026-03-28 05:01:41 [auto1.nl] INFO: Found listing with ID: PN49901
2026-03-28 05:01:41 [auto1.nl] INFO: Found listing with ID: RY20438
2026-03-28 05:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RY20438%27 HTTP/1.1" 200 None
2026-03-28 05:01:41 [auto1.nl] INFO: Scrape type for RY20438: 0
2026-03-28 05:01:41 [auto1.nl] INFO: Found listing with ID: WA98443
2026-03-28 05:01:41 [auto1.nl] INFO: Found listing with ID: PP40573
2026-03-28 05:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PP40573%27 HTTP/1.1" 200 None
2026-03-28 05:01:41 [auto1.nl] INFO: Scrape type for PP40573: 0
2026-03-28 05:01:41 [auto1.nl] INFO: Found listing with ID: RJ32742
2026-03-28 05:01:41 [auto1.nl] INFO: Found listing with ID: LC20908
2026-03-28 05:01:41 [auto1.nl] INFO: Found listing with ID: GJ08711
2026-03-28 05:01:41 [auto1.nl] INFO: Found listing with ID: TV49016
2026-03-28 05:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TV49016%27 HTTP/1.1" 200 None
2026-03-28 05:01:41 [auto1.nl] INFO: Scrape type for TV49016: 2
2026-03-28 05:01:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 77fb9955-e732-5598-a2e3-6d95d88a82a6 with identifier: TV49016
2026-03-28 05:01:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 77fb9955-e732-5598-a2e3-6d95d88a82a6 with scrape type 2
2026-03-28 05:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 77fb9955-e732-5598-a2e3-6d95d88a82a6 with scrape type 2
2026-03-28 05:01:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 77fb9955-e732-5598-a2e3-6d95d88a82a6, identifier: TV49016
2026-03-28 05:01:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 77fb9955-e732-5598-a2e3-6d95d88a82a6 with identifier: TV49016
2026-03-28 05:01:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 77fb9955-e732-5598-a2e3-6d95d88a82a6 with identifier: TV49016
2026-03-28 05:01:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 77fb9955-e732-5598-a2e3-6d95d88a82a6 with identifier: TV49016 to the API
2026-03-28 05:01:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:01:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:01:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-28T16:16:19Z',
 'fuel_type': 'petrol',
 'id': '77fb9955-e732-5598-a2e3-6d95d88a82a6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TV49016',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 225061,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2001-12-18',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 180',
 'transmission': 'manual',
 'trim': '',
 'year': 2001}
2026-03-28 05:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TV49016%27 HTTP/1.1" 200 None
2026-03-28 05:01:41 [auto1.nl] INFO: Saving data for TV49016: {'auction_closing_time': 1774714579.0, 'created_time': 1774465349.34528, 'last_price_update_time': 1774674101.825403}
2026-03-28 05:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='TV49016') HTTP/1.1" 204 0
2026-03-28 05:01:41 [auto1.nl] INFO: Found listing with ID: MR73967
2026-03-28 05:01:41 [auto1.nl] INFO: Found listing with ID: VA79192
2026-03-28 05:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VA79192%27 HTTP/1.1" 200 None
2026-03-28 05:01:41 [auto1.nl] INFO: Scrape type for VA79192: 0
2026-03-28 05:01:41 [auto1.nl] INFO: Found listing with ID: TD05711
2026-03-28 05:01:42 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:01:42 [auto1.nl] INFO: Channel: 24h | Page: 13 | totalHits: 917 | hits on page: 40
2026-03-28 05:01:42 [auto1.nl] INFO: Found listing with ID: GR72952
2026-03-28 05:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GR72952%27 HTTP/1.1" 200 None
2026-03-28 05:01:42 [auto1.nl] INFO: Scrape type for GR72952: 0
2026-03-28 05:01:42 [auto1.nl] INFO: Found listing with ID: TV28211
2026-03-28 05:01:42 [auto1.nl] INFO: Found listing with ID: NB61734
2026-03-28 05:01:42 [auto1.nl] INFO: Found listing with ID: NZ51488
2026-03-28 05:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NZ51488%27 HTTP/1.1" 200 None
2026-03-28 05:01:42 [auto1.nl] INFO: Scrape type for NZ51488: 0
2026-03-28 05:01:42 [auto1.nl] INFO: Found listing with ID: RP69884
2026-03-28 05:01:42 [auto1.nl] INFO: Found listing with ID: NK23750
2026-03-28 05:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NK23750%27 HTTP/1.1" 200 None
2026-03-28 05:01:42 [auto1.nl] INFO: Scrape type for NK23750: 2
2026-03-28 05:01:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 022e46ed-f385-5f97-9025-5398e8a74e7f with identifier: NK23750
2026-03-28 05:01:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 022e46ed-f385-5f97-9025-5398e8a74e7f with scrape type 2
2026-03-28 05:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 022e46ed-f385-5f97-9025-5398e8a74e7f with scrape type 2
2026-03-28 05:01:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 022e46ed-f385-5f97-9025-5398e8a74e7f, identifier: NK23750
2026-03-28 05:01:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 022e46ed-f385-5f97-9025-5398e8a74e7f with identifier: NK23750
2026-03-28 05:01:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 022e46ed-f385-5f97-9025-5398e8a74e7f with identifier: NK23750
2026-03-28 05:01:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 022e46ed-f385-5f97-9025-5398e8a74e7f with identifier: NK23750 to the API
2026-03-28 05:01:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:01:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:01:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:30:45Z',
 'fuel_type': 'petrol',
 'id': '022e46ed-f385-5f97-9025-5398e8a74e7f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NK23750',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 102673,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-05-02',
 'seller_name': None,
 'title': 'Volkswagen Tiguan 1.5 TSI ACT Highline BlueMotion',
 'transmission': 'automatic',
 'trim': 'Highline BlueMotion',
 'year': 2019}
2026-03-28 05:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NK23750%27 HTTP/1.1" 200 None
2026-03-28 05:01:43 [auto1.nl] INFO: Saving data for NK23750: {'auction_closing_time': 1774715445.0, 'created_time': 1774551765.94995, 'last_price_update_time': 1774674103.352986}
2026-03-28 05:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='NK23750') HTTP/1.1" 204 0
2026-03-28 05:01:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:01:43 [auto1.nl] INFO: Found listing with ID: HM04115
2026-03-28 05:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HM04115%27 HTTP/1.1" 200 None
2026-03-28 05:01:43 [auto1.nl] INFO: Scrape type for HM04115: 2
2026-03-28 05:01:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 66c44772-37ea-5eea-90dd-fdf40db2baa7 with identifier: HM04115
2026-03-28 05:01:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 66c44772-37ea-5eea-90dd-fdf40db2baa7 with scrape type 2
2026-03-28 05:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 66c44772-37ea-5eea-90dd-fdf40db2baa7 with scrape type 2
2026-03-28 05:01:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 66c44772-37ea-5eea-90dd-fdf40db2baa7, identifier: HM04115
2026-03-28 05:01:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 66c44772-37ea-5eea-90dd-fdf40db2baa7 with identifier: HM04115
2026-03-28 05:01:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 05:01:43 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=yellow HTTP/1.1" 200 None
2026-03-28 05:01:43 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 05:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 05:01:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 66c44772-37ea-5eea-90dd-fdf40db2baa7 with identifier: HM04115
2026-03-28 05:01:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 66c44772-37ea-5eea-90dd-fdf40db2baa7 with identifier: HM04115 to the API
2026-03-28 05:01:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:01:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:01:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'yellow',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-28T16:25:03Z',
 'fuel_type': 'petrol',
 'id': '66c44772-37ea-5eea-90dd-fdf40db2baa7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HM04115',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'Getz',
 'odometer': 120448,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2003-11-03',
 'seller_name': None,
 'title': 'Hyundai Getz 1.6 GLS',
 'transmission': 'automatic',
 'trim': 'GLS',
 'year': 2003}
2026-03-28 05:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HM04115%27 HTTP/1.1" 200 None
2026-03-28 05:01:43 [auto1.nl] INFO: Saving data for HM04115: {'auction_closing_time': 1774715103.0, 'created_time': 1774465260.072488, 'last_price_update_time': 1774674103.959096}
2026-03-28 05:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='HM04115') HTTP/1.1" 204 0
2026-03-28 05:01:43 [auto1.nl] INFO: Found listing with ID: VL52985
2026-03-28 05:01:43 [auto1.nl] INFO: Found listing with ID: EL39193
2026-03-28 05:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EL39193%27 HTTP/1.1" 200 None
2026-03-28 05:01:44 [auto1.nl] INFO: Scrape type for EL39193: 0
2026-03-28 05:01:44 [auto1.nl] INFO: Found listing with ID: BA16838
2026-03-28 05:01:44 [auto1.nl] INFO: Found listing with ID: SS31744
2026-03-28 05:01:44 [auto1.nl] INFO: Found listing with ID: US61568
2026-03-28 05:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27US61568%27 HTTP/1.1" 200 None
2026-03-28 05:01:44 [auto1.nl] INFO: Scrape type for US61568: 0
2026-03-28 05:01:44 [auto1.nl] INFO: Found listing with ID: TP84646
2026-03-28 05:01:44 [auto1.nl] INFO: Found listing with ID: RM20026
2026-03-28 05:01:44 [auto1.nl] INFO: Found listing with ID: MX87704
2026-03-28 05:01:44 [auto1.nl] INFO: Found listing with ID: KT95598
2026-03-28 05:01:44 [auto1.nl] INFO: Found listing with ID: WC55998
2026-03-28 05:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WC55998%27 HTTP/1.1" 200 None
2026-03-28 05:01:44 [auto1.nl] INFO: Scrape type for WC55998: 0
2026-03-28 05:01:44 [auto1.nl] INFO: Found listing with ID: WH77322
2026-03-28 05:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WH77322%27 HTTP/1.1" 200 None
2026-03-28 05:01:44 [auto1.nl] INFO: Scrape type for WH77322: 0
2026-03-28 05:01:44 [auto1.nl] INFO: Found listing with ID: EG83115
2026-03-28 05:01:44 [auto1.nl] INFO: Found listing with ID: PZ45874
2026-03-28 05:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PZ45874%27 HTTP/1.1" 200 None
2026-03-28 05:01:44 [auto1.nl] INFO: Scrape type for PZ45874: 0
2026-03-28 05:01:44 [auto1.nl] INFO: Found listing with ID: EH98197
2026-03-28 05:01:44 [auto1.nl] INFO: Found listing with ID: JZ35389
2026-03-28 05:01:44 [auto1.nl] INFO: Found listing with ID: HG56616
2026-03-28 05:01:44 [auto1.nl] INFO: Found listing with ID: FD60498
2026-03-28 05:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FD60498%27 HTTP/1.1" 200 None
2026-03-28 05:01:44 [auto1.nl] INFO: Scrape type for FD60498: 0
2026-03-28 05:01:44 [auto1.nl] INFO: Found listing with ID: MR89214
2026-03-28 05:01:44 [auto1.nl] INFO: Found listing with ID: SG32295
2026-03-28 05:01:44 [auto1.nl] INFO: Found listing with ID: TJ11018
2026-03-28 05:01:44 [auto1.nl] INFO: Found listing with ID: HL48318
2026-03-28 05:01:44 [auto1.nl] INFO: Found listing with ID: VN36525
2026-03-28 05:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VN36525%27 HTTP/1.1" 200 None
2026-03-28 05:01:44 [auto1.nl] INFO: Scrape type for VN36525: 0
2026-03-28 05:01:44 [auto1.nl] INFO: Found listing with ID: RC82380
2026-03-28 05:01:44 [auto1.nl] INFO: Found listing with ID: JZ14599
2026-03-28 05:01:44 [auto1.nl] INFO: Found listing with ID: AX28541
2026-03-28 05:01:44 [auto1.nl] INFO: Found listing with ID: KK31365
2026-03-28 05:01:44 [auto1.nl] INFO: Found listing with ID: ZR40703
2026-03-28 05:01:44 [auto1.nl] INFO: Found listing with ID: SV22652
2026-03-28 05:01:44 [auto1.nl] INFO: Found listing with ID: NM97362
2026-03-28 05:01:44 [auto1.nl] INFO: Found listing with ID: LE78061
2026-03-28 05:01:44 [auto1.nl] INFO: Found listing with ID: MD18353
2026-03-28 05:01:44 [auto1.nl] INFO: Found listing with ID: PM08403
2026-03-28 05:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PM08403%27 HTTP/1.1" 200 None
2026-03-28 05:01:44 [auto1.nl] INFO: Scrape type for PM08403: 0
2026-03-28 05:01:44 [auto1.nl] INFO: Found listing with ID: JL68792
2026-03-28 05:01:45 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:01:45 [auto1.nl] INFO: Channel: 24h | Page: 14 | totalHits: 917 | hits on page: 40
2026-03-28 05:01:45 [auto1.nl] INFO: Found listing with ID: UK83589
2026-03-28 05:01:45 [auto1.nl] INFO: Found listing with ID: JM82020
2026-03-28 05:01:45 [auto1.nl] INFO: Found listing with ID: LX95579
2026-03-28 05:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LX95579%27 HTTP/1.1" 200 None
2026-03-28 05:01:45 [auto1.nl] INFO: Scrape type for LX95579: 2
2026-03-28 05:01:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4b8572d1-1a75-52f5-b018-601c2192befa with identifier: LX95579
2026-03-28 05:01:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4b8572d1-1a75-52f5-b018-601c2192befa with scrape type 2
2026-03-28 05:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4b8572d1-1a75-52f5-b018-601c2192befa with scrape type 2
2026-03-28 05:01:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 4b8572d1-1a75-52f5-b018-601c2192befa, identifier: LX95579
2026-03-28 05:01:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 4b8572d1-1a75-52f5-b018-601c2192befa with identifier: LX95579
2026-03-28 05:01:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 4b8572d1-1a75-52f5-b018-601c2192befa with identifier: LX95579
2026-03-28 05:01:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 4b8572d1-1a75-52f5-b018-601c2192befa with identifier: LX95579 to the API
2026-03-28 05:01:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:01:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:01:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 135,
 'expiration_date': '2026-03-28T16:27:37Z',
 'fuel_type': 'petrol',
 'id': '4b8572d1-1a75-52f5-b018-601c2192befa',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LX95579',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'i30',
 'odometer': 246058,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-01-09',
 'seller_name': None,
 'title': 'Hyundai i30 1.6 GDI Trend',
 'transmission': 'manual',
 'trim': 'Trend',
 'year': 2014}
2026-03-28 05:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LX95579%27 HTTP/1.1" 200 None
2026-03-28 05:01:45 [auto1.nl] INFO: Saving data for LX95579: {'auction_closing_time': 1774715257.0, 'created_time': 1774465395.4341, 'last_price_update_time': 1774674105.680872}
2026-03-28 05:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='LX95579') HTTP/1.1" 204 0
2026-03-28 05:01:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:01:45 [auto1.nl] INFO: Found listing with ID: MW16655
2026-03-28 05:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MW16655%27 HTTP/1.1" 200 None
2026-03-28 05:01:45 [auto1.nl] INFO: Scrape type for MW16655: 0
2026-03-28 05:01:45 [auto1.nl] INFO: Found listing with ID: KK04481
2026-03-28 05:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KK04481%27 HTTP/1.1" 200 None
2026-03-28 05:01:45 [auto1.nl] INFO: Scrape type for KK04481: 2
2026-03-28 05:01:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6f057ac2-25b7-5e4f-a51d-bca583ad75bb with identifier: KK04481
2026-03-28 05:01:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6f057ac2-25b7-5e4f-a51d-bca583ad75bb with scrape type 2
2026-03-28 05:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6f057ac2-25b7-5e4f-a51d-bca583ad75bb with scrape type 2
2026-03-28 05:01:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 6f057ac2-25b7-5e4f-a51d-bca583ad75bb, identifier: KK04481
2026-03-28 05:01:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 6f057ac2-25b7-5e4f-a51d-bca583ad75bb with identifier: KK04481
2026-03-28 05:01:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 6f057ac2-25b7-5e4f-a51d-bca583ad75bb with identifier: KK04481
2026-03-28 05:01:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 6f057ac2-25b7-5e4f-a51d-bca583ad75bb with identifier: KK04481 to the API
2026-03-28 05:01:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:01:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:01:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 111,
 'expiration_date': '2026-03-28T16:43:33Z',
 'fuel_type': 'petrol',
 'id': '6f057ac2-25b7-5e4f-a51d-bca583ad75bb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KK04481',
 'listing': 'auction',
 'make': 'MG',
 'model': 'ZS',
 'odometer': 86852,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-06-07',
 'seller_name': None,
 'title': 'MG ZS 1.0 T-GDI Luxury',
 'transmission': 'automatic',
 'trim': 'Luxury',
 'year': 2021}
2026-03-28 05:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KK04481%27 HTTP/1.1" 200 None
2026-03-28 05:01:46 [auto1.nl] INFO: Saving data for KK04481: {'auction_closing_time': 1774716213.0, 'created_time': 1774465406.025241, 'last_price_update_time': 1774674106.235678}
2026-03-28 05:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='KK04481') HTTP/1.1" 204 0
2026-03-28 05:01:46 [auto1.nl] INFO: Found listing with ID: RT17699
2026-03-28 05:01:46 [auto1.nl] INFO: Found listing with ID: NT73578
2026-03-28 05:01:46 [auto1.nl] INFO: Found listing with ID: ZP63957
2026-03-28 05:01:46 [auto1.nl] INFO: Found listing with ID: ZX00670
2026-03-28 05:01:46 [auto1.nl] INFO: Found listing with ID: NS77626
2026-03-28 05:01:46 [auto1.nl] INFO: Found listing with ID: GT27619
2026-03-28 05:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GT27619%27 HTTP/1.1" 200 None
2026-03-28 05:01:46 [auto1.nl] INFO: Scrape type for GT27619: 0
2026-03-28 05:01:46 [auto1.nl] INFO: Found listing with ID: DA68002
2026-03-28 05:01:46 [auto1.nl] INFO: Found listing with ID: BU17435
2026-03-28 05:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BU17435%27 HTTP/1.1" 200 None
2026-03-28 05:01:46 [auto1.nl] INFO: Scrape type for BU17435: 2
2026-03-28 05:01:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cd18abc1-90be-53b8-85e6-ece85a6b176f with identifier: BU17435
2026-03-28 05:01:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cd18abc1-90be-53b8-85e6-ece85a6b176f with scrape type 2
2026-03-28 05:01:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cd18abc1-90be-53b8-85e6-ece85a6b176f with scrape type 2
2026-03-28 05:01:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: cd18abc1-90be-53b8-85e6-ece85a6b176f, identifier: BU17435
2026-03-28 05:01:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: cd18abc1-90be-53b8-85e6-ece85a6b176f with identifier: BU17435
2026-03-28 05:01:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: cd18abc1-90be-53b8-85e6-ece85a6b176f with identifier: BU17435
2026-03-28 05:01:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: cd18abc1-90be-53b8-85e6-ece85a6b176f with identifier: BU17435 to the API
2026-03-28 05:01:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:01:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:01:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 85,
 'expiration_date': '2026-03-28T16:49:32Z',
 'fuel_type': 'petrol',
 'id': 'cd18abc1-90be-53b8-85e6-ece85a6b176f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BU17435',
 'listing': 'auction',
 'make': 'Fiat',
 'model': '500',
 'odometer': 88809,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-07-30',
 'seller_name': None,
 'title': 'Fiat 500 0.9 Pop',
 'transmission': 'manual',
 'trim': 'Pop',
 'year': 2017}
2026-03-28 05:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BU17435%27 HTTP/1.1" 200 None
2026-03-28 05:01:46 [auto1.nl] INFO: Saving data for BU17435: {'auction_closing_time': 1774716572.0, 'created_time': 1774465417.174777, 'last_price_update_time': 1774674106.76577}
2026-03-28 05:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='BU17435') HTTP/1.1" 204 0
2026-03-28 05:01:46 [auto1.nl] INFO: Found listing with ID: FH97185
2026-03-28 05:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FH97185%27 HTTP/1.1" 200 None
2026-03-28 05:01:46 [auto1.nl] INFO: Scrape type for FH97185: 0
2026-03-28 05:01:46 [auto1.nl] INFO: Found listing with ID: LX15335
2026-03-28 05:01:46 [auto1.nl] INFO: Found listing with ID: KF13201
2026-03-28 05:01:46 [auto1.nl] INFO: Found listing with ID: FJ04475
2026-03-28 05:01:46 [auto1.nl] INFO: Found listing with ID: GG50012
2026-03-28 05:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GG50012%27 HTTP/1.1" 200 None
2026-03-28 05:01:46 [auto1.nl] INFO: Scrape type for GG50012: 0
2026-03-28 05:01:46 [auto1.nl] INFO: Found listing with ID: NM87332
2026-03-28 05:01:46 [auto1.nl] INFO: Found listing with ID: WV31023
2026-03-28 05:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WV31023%27 HTTP/1.1" 200 None
2026-03-28 05:01:46 [auto1.nl] INFO: Scrape type for WV31023: 2
2026-03-28 05:01:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a8446046-65c8-5435-9c15-7ab46052fcd9 with identifier: WV31023
2026-03-28 05:01:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a8446046-65c8-5435-9c15-7ab46052fcd9 with scrape type 2
2026-03-28 05:01:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a8446046-65c8-5435-9c15-7ab46052fcd9 with scrape type 2
2026-03-28 05:01:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: a8446046-65c8-5435-9c15-7ab46052fcd9, identifier: WV31023
2026-03-28 05:01:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: a8446046-65c8-5435-9c15-7ab46052fcd9 with identifier: WV31023
2026-03-28 05:01:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: a8446046-65c8-5435-9c15-7ab46052fcd9 with identifier: WV31023
2026-03-28 05:01:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: a8446046-65c8-5435-9c15-7ab46052fcd9 with identifier: WV31023 to the API
2026-03-28 05:01:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 05:01:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 05:01:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-28T16:25:49Z',
 'fuel_type': 'petrol',
 'id': 'a8446046-65c8-5435-9c15-7ab46052fcd9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WV31023',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'C-Max',
 'odometer': 171062,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-12-01',
 'seller_name': None,
 'title': 'Ford C-Max 1.8 Black Magic',
 'transmission': 'manual',
 'trim': 'Black Magic',
 'year': 2009}
2026-03-28 05:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WV31023%27 HTTP/1.1" 200 None
2026-03-28 05:01:47 [auto1.nl] INFO: Saving data for WV31023: {'auction_closing_time': 1774715149.0, 'created_time': 1774465254.643986, 'last_price_update_time': 1774674107.329203}
2026-03-28 05:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='WV31023') HTTP/1.1" 204 0
2026-03-28 05:01:47 [auto1.nl] INFO: Found listing with ID: NH92548
2026-03-28 05:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NH92548%27 HTTP/1.1" 200 None
2026-03-28 05:01:47 [auto1.nl] INFO: Scrape type for NH92548: 0
2026-03-28 05:01:47 [auto1.nl] INFO: Found listing with ID: KC46486
2026-03-28 05:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KC46486%27 HTTP/1.1" 200 None
2026-03-28 05:01:47 [auto1.nl] INFO: Scrape type for KC46486: 0
2026-03-28 05:01:47 [auto1.nl] INFO: Found listing with ID: BE07790
2026-03-28 05:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BE07790%27 HTTP/1.1" 200 None
2026-03-28 05:01:47 [auto1.nl] INFO: Scrape type for BE07790: 0
2026-03-28 05:01:47 [auto1.nl] INFO: Found listing with ID: WK39469
2026-03-28 05:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WK39469%27 HTTP/1.1" 200 None
2026-03-28 05:01:47 [auto1.nl] INFO: Scrape type for WK39469: 0
2026-03-28 05:01:47 [auto1.nl] INFO: Found listing with ID: CP88423
2026-03-28 05:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CP88423%27 HTTP/1.1" 200 None
2026-03-28 05:01:47 [auto1.nl] INFO: Scrape type for CP88423: 0
2026-03-28 05:01:47 [auto1.nl] INFO: Found listing with ID: VA53958
2026-03-28 05:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VA53958%27 HTTP/1.1" 200 None
2026-03-28 05:01:47 [auto1.nl] INFO: Scrape type for VA53958: 0
2026-03-28 05:01:47 [auto1.nl] INFO: Found listing with ID: MN54197
2026-03-28 05:01:47 [auto1.nl] INFO: Found listing with ID: VW77077
2026-03-28 05:01:47 [auto1.nl] INFO: Found listing with ID: JN17461
2026-03-28 05:01:47 [auto1.nl] INFO: Found listing with ID: MF32327
2026-03-28 05:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MF32327%27 HTTP/1.1" 200 None
2026-03-28 05:01:47 [auto1.nl] INFO: Scrape type for MF32327: 0
2026-03-28 05:01:47 [auto1.nl] INFO: Found listing with ID: RT28324
2026-03-28 05:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RT28324%27 HTTP/1.1" 200 None
2026-03-28 05:01:47 [auto1.nl] INFO: Scrape type for RT28324: 0
2026-03-28 05:01:47 [auto1.nl] INFO: Found listing with ID: HC37182
2026-03-28 05:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HC37182%27 HTTP/1.1" 200 None
2026-03-28 05:01:47 [auto1.nl] INFO: Scrape type for HC37182: 0
2026-03-28 05:01:47 [auto1.nl] INFO: Found listing with ID: AJ89396
2026-03-28 05:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AJ89396%27 HTTP/1.1" 200 None
2026-03-28 05:01:47 [auto1.nl] INFO: Scrape type for AJ89396: 0
2026-03-28 05:01:47 [auto1.nl] INFO: Found listing with ID: GD14705
2026-03-28 05:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GD14705%27 HTTP/1.1" 200 None
2026-03-28 05:01:47 [auto1.nl] INFO: Scrape type for GD14705: 0
2026-03-28 05:01:47 [auto1.nl] INFO: Found listing with ID: CT04767
2026-03-28 05:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CT04767%27 HTTP/1.1" 200 None
2026-03-28 05:01:47 [auto1.nl] INFO: Scrape type for CT04767: 0
2026-03-28 05:01:47 [auto1.nl] INFO: Found listing with ID: NS14796
2026-03-28 05:01:47 [auto1.nl] INFO: Found listing with ID: BP47777
2026-03-28 05:01:47 [auto1.nl] INFO: Found listing with ID: ER73656
2026-03-28 05:01:47 [auto1.nl] INFO: Found listing with ID: DM27085
2026-03-28 05:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DM27085%27 HTTP/1.1" 200 None
2026-03-28 05:01:47 [auto1.nl] INFO: Scrape type for DM27085: 0
2026-03-28 05:01:47 [auto1.nl] INFO: Found listing with ID: GM90003
2026-03-28 05:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GM90003%27 HTTP/1.1" 200 None
2026-03-28 05:01:47 [auto1.nl] INFO: Scrape type for GM90003: 0
2026-03-28 05:01:48 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:01:48 [auto1.nl] INFO: Channel: 24h | Page: 15 | totalHits: 917 | hits on page: 40
2026-03-28 05:01:48 [auto1.nl] INFO: Found listing with ID: LZ58703
2026-03-28 05:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LZ58703%27 HTTP/1.1" 200 None
2026-03-28 05:01:48 [auto1.nl] INFO: Scrape type for LZ58703: 0
2026-03-28 05:01:48 [auto1.nl] INFO: Found listing with ID: DX40194
2026-03-28 05:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DX40194%27 HTTP/1.1" 200 None
2026-03-28 05:01:48 [auto1.nl] INFO: Scrape type for DX40194: 0
2026-03-28 05:01:48 [auto1.nl] INFO: Found listing with ID: HB03885
2026-03-28 05:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HB03885%27 HTTP/1.1" 200 None
2026-03-28 05:01:48 [auto1.nl] INFO: Scrape type for HB03885: 0
2026-03-28 05:01:48 [auto1.nl] INFO: Found listing with ID: WB40041
2026-03-28 05:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WB40041%27 HTTP/1.1" 200 None
2026-03-28 05:01:48 [auto1.nl] INFO: Scrape type for WB40041: 0
2026-03-28 05:01:48 [auto1.nl] INFO: Found listing with ID: GR22460
2026-03-28 05:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GR22460%27 HTTP/1.1" 200 None
2026-03-28 05:01:48 [auto1.nl] INFO: Scrape type for GR22460: 0
2026-03-28 05:01:48 [auto1.nl] INFO: Found listing with ID: FJ96412
2026-03-28 05:01:48 [auto1.nl] INFO: Found listing with ID: UV51543
2026-03-28 05:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UV51543%27 HTTP/1.1" 200 None
2026-03-28 05:01:48 [auto1.nl] INFO: Scrape type for UV51543: 0
2026-03-28 05:01:48 [auto1.nl] INFO: Found listing with ID: VH11794
2026-03-28 05:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VH11794%27 HTTP/1.1" 200 None
2026-03-28 05:01:48 [auto1.nl] INFO: Scrape type for VH11794: 0
2026-03-28 05:01:48 [auto1.nl] INFO: Found listing with ID: MP41726
2026-03-28 05:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MP41726%27 HTTP/1.1" 200 None
2026-03-28 05:01:48 [auto1.nl] INFO: Scrape type for MP41726: 0
2026-03-28 05:01:48 [auto1.nl] INFO: Found listing with ID: BM39529
2026-03-28 05:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BM39529%27 HTTP/1.1" 200 None
2026-03-28 05:01:48 [auto1.nl] INFO: Scrape type for BM39529: 0
2026-03-28 05:01:48 [auto1.nl] INFO: Found listing with ID: HT16720
2026-03-28 05:01:48 [auto1.nl] INFO: Found listing with ID: XC91044
2026-03-28 05:01:48 [auto1.nl] INFO: Found listing with ID: BN75332
2026-03-28 05:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BN75332%27 HTTP/1.1" 200 None
2026-03-28 05:01:48 [auto1.nl] INFO: Scrape type for BN75332: 0
2026-03-28 05:01:48 [auto1.nl] INFO: Found listing with ID: CM13419
2026-03-28 05:01:48 [auto1.nl] INFO: Found listing with ID: ZD81791
2026-03-28 05:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZD81791%27 HTTP/1.1" 200 None
2026-03-28 05:01:48 [auto1.nl] INFO: Scrape type for ZD81791: 0
2026-03-28 05:01:48 [auto1.nl] INFO: Found listing with ID: CE53949
2026-03-28 05:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CE53949%27 HTTP/1.1" 200 None
2026-03-28 05:01:48 [auto1.nl] INFO: Scrape type for CE53949: 0
2026-03-28 05:01:48 [auto1.nl] INFO: Found listing with ID: AL57491
2026-03-28 05:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AL57491%27 HTTP/1.1" 200 None
2026-03-28 05:01:48 [auto1.nl] INFO: Scrape type for AL57491: 0
2026-03-28 05:01:48 [auto1.nl] INFO: Found listing with ID: EX83153
2026-03-28 05:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EX83153%27 HTTP/1.1" 200 None
2026-03-28 05:01:48 [auto1.nl] INFO: Scrape type for EX83153: 0
2026-03-28 05:01:48 [auto1.nl] INFO: Found listing with ID: SG18673
2026-03-28 05:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SG18673%27 HTTP/1.1" 200 None
2026-03-28 05:01:48 [auto1.nl] INFO: Scrape type for SG18673: 0
2026-03-28 05:01:48 [auto1.nl] INFO: Found listing with ID: DL78347
2026-03-28 05:01:48 [auto1.nl] INFO: Found listing with ID: DX59899
2026-03-28 05:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DX59899%27 HTTP/1.1" 200 None
2026-03-28 05:01:48 [auto1.nl] INFO: Scrape type for DX59899: 0
2026-03-28 05:01:48 [auto1.nl] INFO: Found listing with ID: EJ17993
2026-03-28 05:01:48 [auto1.nl] INFO: Found listing with ID: WS72354
2026-03-28 05:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WS72354%27 HTTP/1.1" 200 None
2026-03-28 05:01:49 [auto1.nl] INFO: Scrape type for WS72354: 0
2026-03-28 05:01:49 [auto1.nl] INFO: Found listing with ID: FD56899
2026-03-28 05:01:49 [auto1.nl] INFO: Found listing with ID: AW61305
2026-03-28 05:01:49 [auto1.nl] INFO: Found listing with ID: NL82021
2026-03-28 05:01:49 [auto1.nl] INFO: Found listing with ID: RD71224
2026-03-28 05:01:49 [auto1.nl] INFO: Found listing with ID: CR11915
2026-03-28 05:01:49 [auto1.nl] INFO: Found listing with ID: TV97350
2026-03-28 05:01:49 [auto1.nl] INFO: Found listing with ID: BA20726
2026-03-28 05:01:49 [auto1.nl] INFO: Found listing with ID: YT17806
2026-03-28 05:01:49 [auto1.nl] INFO: Found listing with ID: FA84913
2026-03-28 05:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FA84913%27 HTTP/1.1" 200 None
2026-03-28 05:01:49 [auto1.nl] INFO: Scrape type for FA84913: 0
2026-03-28 05:01:49 [auto1.nl] INFO: Found listing with ID: JP82620
2026-03-28 05:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JP82620%27 HTTP/1.1" 200 None
2026-03-28 05:01:49 [auto1.nl] INFO: Scrape type for JP82620: 0
2026-03-28 05:01:49 [auto1.nl] INFO: Found listing with ID: SY92282
2026-03-28 05:01:49 [auto1.nl] INFO: Found listing with ID: UY18740
2026-03-28 05:01:49 [auto1.nl] INFO: Found listing with ID: JB49049
2026-03-28 05:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JB49049%27 HTTP/1.1" 200 None
2026-03-28 05:01:49 [auto1.nl] INFO: Scrape type for JB49049: 0
2026-03-28 05:01:49 [auto1.nl] INFO: Found listing with ID: XW90615
2026-03-28 05:01:49 [auto1.nl] INFO: Found listing with ID: RM92541
2026-03-28 05:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RM92541%27 HTTP/1.1" 200 None
2026-03-28 05:01:49 [auto1.nl] INFO: Scrape type for RM92541: 0
2026-03-28 05:01:49 [auto1.nl] INFO: Found listing with ID: XV86348
2026-03-28 05:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XV86348%27 HTTP/1.1" 200 None
2026-03-28 05:01:49 [auto1.nl] INFO: Scrape type for XV86348: 0
2026-03-28 05:01:49 [auto1.nl] INFO: Found listing with ID: NL79871
2026-03-28 05:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NL79871%27 HTTP/1.1" 200 None
2026-03-28 05:01:49 [auto1.nl] INFO: Scrape type for NL79871: 0
2026-03-28 05:01:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:01:50 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:01:50 [auto1.nl] INFO: Channel: 24h | Page: 16 | totalHits: 917 | hits on page: 40
2026-03-28 05:01:50 [auto1.nl] INFO: Found listing with ID: PE89486
2026-03-28 05:01:50 [auto1.nl] INFO: Found listing with ID: WM00486
2026-03-28 05:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WM00486%27 HTTP/1.1" 200 None
2026-03-28 05:01:50 [auto1.nl] INFO: Scrape type for WM00486: 0
2026-03-28 05:01:50 [auto1.nl] INFO: Found listing with ID: SE73966
2026-03-28 05:01:50 [auto1.nl] INFO: Found listing with ID: YM72619
2026-03-28 05:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YM72619%27 HTTP/1.1" 200 None
2026-03-28 05:01:50 [auto1.nl] INFO: Scrape type for YM72619: 0
2026-03-28 05:01:50 [auto1.nl] INFO: Found listing with ID: MY24327
2026-03-28 05:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MY24327%27 HTTP/1.1" 200 None
2026-03-28 05:01:50 [auto1.nl] INFO: Scrape type for MY24327: 0
2026-03-28 05:01:50 [auto1.nl] INFO: Found listing with ID: BB30302
2026-03-28 05:01:50 [auto1.nl] INFO: Found listing with ID: EM31499
2026-03-28 05:01:50 [auto1.nl] INFO: Found listing with ID: CU03556
2026-03-28 05:01:50 [auto1.nl] INFO: Found listing with ID: UB53809
2026-03-28 05:01:50 [auto1.nl] INFO: Found listing with ID: EL08717
2026-03-28 05:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EL08717%27 HTTP/1.1" 200 None
2026-03-28 05:01:50 [auto1.nl] INFO: Scrape type for EL08717: 0
2026-03-28 05:01:50 [auto1.nl] INFO: Found listing with ID: FD20387
2026-03-28 05:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FD20387%27 HTTP/1.1" 200 None
2026-03-28 05:01:50 [auto1.nl] INFO: Scrape type for FD20387: 0
2026-03-28 05:01:50 [auto1.nl] INFO: Found listing with ID: HL89699
2026-03-28 05:01:50 [auto1.nl] INFO: Found listing with ID: HF10176
2026-03-28 05:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HF10176%27 HTTP/1.1" 200 None
2026-03-28 05:01:50 [auto1.nl] INFO: Scrape type for HF10176: 0
2026-03-28 05:01:50 [auto1.nl] INFO: Found listing with ID: KB01407
2026-03-28 05:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KB01407%27 HTTP/1.1" 200 None
2026-03-28 05:01:50 [auto1.nl] INFO: Scrape type for KB01407: 0
2026-03-28 05:01:50 [auto1.nl] INFO: Found listing with ID: NB67844
2026-03-28 05:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NB67844%27 HTTP/1.1" 200 None
2026-03-28 05:01:50 [auto1.nl] INFO: Scrape type for NB67844: 0
2026-03-28 05:01:50 [auto1.nl] INFO: Found listing with ID: TY02674
2026-03-28 05:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TY02674%27 HTTP/1.1" 200 None
2026-03-28 05:01:50 [auto1.nl] INFO: Scrape type for TY02674: 0
2026-03-28 05:01:50 [auto1.nl] INFO: Found listing with ID: SD85786
2026-03-28 05:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SD85786%27 HTTP/1.1" 200 None
2026-03-28 05:01:50 [auto1.nl] INFO: Scrape type for SD85786: 0
2026-03-28 05:01:50 [auto1.nl] INFO: Found listing with ID: FR73964
2026-03-28 05:01:50 [auto1.nl] INFO: Found listing with ID: BY94157
2026-03-28 05:01:50 [auto1.nl] INFO: Found listing with ID: HP30662
2026-03-28 05:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HP30662%27 HTTP/1.1" 200 None
2026-03-28 05:01:50 [auto1.nl] INFO: Scrape type for HP30662: 0
2026-03-28 05:01:50 [auto1.nl] INFO: Found listing with ID: MZ83148
2026-03-28 05:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MZ83148%27 HTTP/1.1" 200 None
2026-03-28 05:01:50 [auto1.nl] INFO: Scrape type for MZ83148: 0
2026-03-28 05:01:50 [auto1.nl] INFO: Found listing with ID: TF88410
2026-03-28 05:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TF88410%27 HTTP/1.1" 200 None
2026-03-28 05:01:50 [auto1.nl] INFO: Scrape type for TF88410: 0
2026-03-28 05:01:50 [auto1.nl] INFO: Found listing with ID: YK64597
2026-03-28 05:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YK64597%27 HTTP/1.1" 200 None
2026-03-28 05:01:50 [auto1.nl] INFO: Scrape type for YK64597: 0
2026-03-28 05:01:50 [auto1.nl] INFO: Found listing with ID: AP41268
2026-03-28 05:01:50 [auto1.nl] INFO: Found listing with ID: VP87797
2026-03-28 05:01:50 [auto1.nl] INFO: Found listing with ID: JN86544
2026-03-28 05:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JN86544%27 HTTP/1.1" 200 None
2026-03-28 05:01:50 [auto1.nl] INFO: Scrape type for JN86544: 0
2026-03-28 05:01:50 [auto1.nl] INFO: Found listing with ID: NS74153
2026-03-28 05:01:50 [auto1.nl] INFO: Found listing with ID: SM09418
2026-03-28 05:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SM09418%27 HTTP/1.1" 200 None
2026-03-28 05:01:50 [auto1.nl] INFO: Scrape type for SM09418: 0
2026-03-28 05:01:50 [auto1.nl] INFO: Found listing with ID: GV84229
2026-03-28 05:01:50 [auto1.nl] INFO: Found listing with ID: NN84532
2026-03-28 05:01:50 [auto1.nl] INFO: Found listing with ID: YE34591
2026-03-28 05:01:50 [auto1.nl] INFO: Found listing with ID: FZ65940
2026-03-28 05:01:50 [auto1.nl] INFO: Found listing with ID: TL21960
2026-03-28 05:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TL21960%27 HTTP/1.1" 200 None
2026-03-28 05:01:50 [auto1.nl] INFO: Scrape type for TL21960: 0
2026-03-28 05:01:50 [auto1.nl] INFO: Found listing with ID: MV90025
2026-03-28 05:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MV90025%27 HTTP/1.1" 200 None
2026-03-28 05:01:50 [auto1.nl] INFO: Scrape type for MV90025: 0
2026-03-28 05:01:50 [auto1.nl] INFO: Found listing with ID: GJ92310
2026-03-28 05:01:50 [auto1.nl] INFO: Found listing with ID: UG47676
2026-03-28 05:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UG47676%27 HTTP/1.1" 200 None
2026-03-28 05:01:50 [auto1.nl] INFO: Scrape type for UG47676: 0
2026-03-28 05:01:50 [auto1.nl] INFO: Found listing with ID: AE22840
2026-03-28 05:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AE22840%27 HTTP/1.1" 200 None
2026-03-28 05:01:50 [auto1.nl] INFO: Scrape type for AE22840: 0
2026-03-28 05:01:50 [auto1.nl] INFO: Found listing with ID: FD60713
2026-03-28 05:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FD60713%27 HTTP/1.1" 200 None
2026-03-28 05:01:50 [auto1.nl] INFO: Scrape type for FD60713: 0
2026-03-28 05:01:50 [auto1.nl] INFO: Found listing with ID: TA38332
2026-03-28 05:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TA38332%27 HTTP/1.1" 200 None
2026-03-28 05:01:50 [auto1.nl] INFO: Scrape type for TA38332: 0
2026-03-28 05:01:50 [auto1.nl] INFO: Found listing with ID: WU52252
2026-03-28 05:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WU52252%27 HTTP/1.1" 200 None
2026-03-28 05:01:50 [auto1.nl] INFO: Scrape type for WU52252: 0
2026-03-28 05:01:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:01:51 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:01:51 [auto1.nl] INFO: Channel: 24h | Page: 17 | totalHits: 917 | hits on page: 40
2026-03-28 05:01:51 [auto1.nl] INFO: Found listing with ID: WV54622
2026-03-28 05:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WV54622%27 HTTP/1.1" 200 None
2026-03-28 05:01:51 [auto1.nl] INFO: Scrape type for WV54622: 0
2026-03-28 05:01:51 [auto1.nl] INFO: Found listing with ID: VU71978
2026-03-28 05:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VU71978%27 HTTP/1.1" 200 None
2026-03-28 05:01:51 [auto1.nl] INFO: Scrape type for VU71978: 0
2026-03-28 05:01:51 [auto1.nl] INFO: Found listing with ID: ZR26013
2026-03-28 05:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZR26013%27 HTTP/1.1" 200 None
2026-03-28 05:01:51 [auto1.nl] INFO: Scrape type for ZR26013: 0
2026-03-28 05:01:51 [auto1.nl] INFO: Found listing with ID: FB31523
2026-03-28 05:01:51 [auto1.nl] INFO: Found listing with ID: NF42307
2026-03-28 05:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NF42307%27 HTTP/1.1" 200 None
2026-03-28 05:01:51 [auto1.nl] INFO: Scrape type for NF42307: 0
2026-03-28 05:01:51 [auto1.nl] INFO: Found listing with ID: KV87922
2026-03-28 05:01:51 [auto1.nl] INFO: Found listing with ID: BN23461
2026-03-28 05:01:51 [auto1.nl] INFO: Found listing with ID: DV95890
2026-03-28 05:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DV95890%27 HTTP/1.1" 200 None
2026-03-28 05:01:51 [auto1.nl] INFO: Scrape type for DV95890: 0
2026-03-28 05:01:51 [auto1.nl] INFO: Found listing with ID: DB11708
2026-03-28 05:01:51 [auto1.nl] INFO: Found listing with ID: BN97277
2026-03-28 05:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BN97277%27 HTTP/1.1" 200 None
2026-03-28 05:01:51 [auto1.nl] INFO: Scrape type for BN97277: 0
2026-03-28 05:01:51 [auto1.nl] INFO: Found listing with ID: FG40185
2026-03-28 05:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FG40185%27 HTTP/1.1" 200 None
2026-03-28 05:01:51 [auto1.nl] INFO: Scrape type for FG40185: 0
2026-03-28 05:01:51 [auto1.nl] INFO: Found listing with ID: EG87315
2026-03-28 05:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EG87315%27 HTTP/1.1" 200 None
2026-03-28 05:01:51 [auto1.nl] INFO: Scrape type for EG87315: 0
2026-03-28 05:01:51 [auto1.nl] INFO: Found listing with ID: GZ83628
2026-03-28 05:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GZ83628%27 HTTP/1.1" 200 None
2026-03-28 05:01:51 [auto1.nl] INFO: Scrape type for GZ83628: 0
2026-03-28 05:01:51 [auto1.nl] INFO: Found listing with ID: NA39376
2026-03-28 05:01:51 [auto1.nl] INFO: Found listing with ID: AR80776
2026-03-28 05:01:51 [auto1.nl] INFO: Found listing with ID: PY93062
2026-03-28 05:01:51 [auto1.nl] INFO: Found listing with ID: DD65196
2026-03-28 05:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DD65196%27 HTTP/1.1" 200 None
2026-03-28 05:01:51 [auto1.nl] INFO: Scrape type for DD65196: 0
2026-03-28 05:01:51 [auto1.nl] INFO: Found listing with ID: DD48612
2026-03-28 05:01:51 [auto1.nl] INFO: Found listing with ID: CM00428
2026-03-28 05:01:51 [auto1.nl] INFO: Found listing with ID: JR89598
2026-03-28 05:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JR89598%27 HTTP/1.1" 200 None
2026-03-28 05:01:51 [auto1.nl] INFO: Scrape type for JR89598: 0
2026-03-28 05:01:51 [auto1.nl] INFO: Found listing with ID: KV69786
2026-03-28 05:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KV69786%27 HTTP/1.1" 200 None
2026-03-28 05:01:52 [auto1.nl] INFO: Scrape type for KV69786: 0
2026-03-28 05:01:52 [auto1.nl] INFO: Found listing with ID: TW55830
2026-03-28 05:01:52 [auto1.nl] INFO: Found listing with ID: HH59991
2026-03-28 05:01:52 [auto1.nl] INFO: Found listing with ID: FW39949
2026-03-28 05:01:52 [auto1.nl] INFO: Found listing with ID: UR99157
2026-03-28 05:01:52 [auto1.nl] INFO: Found listing with ID: AM07460
2026-03-28 05:01:52 [auto1.nl] INFO: Found listing with ID: MZ50492
2026-03-28 05:01:52 [auto1.nl] INFO: Found listing with ID: RF39867
2026-03-28 05:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RF39867%27 HTTP/1.1" 200 None
2026-03-28 05:01:52 [auto1.nl] INFO: Scrape type for RF39867: 0
2026-03-28 05:01:52 [auto1.nl] INFO: Found listing with ID: JY58487
2026-03-28 05:01:52 [auto1.nl] INFO: Found listing with ID: TC30391
2026-03-28 05:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TC30391%27 HTTP/1.1" 200 None
2026-03-28 05:01:52 [auto1.nl] INFO: Scrape type for TC30391: 0
2026-03-28 05:01:52 [auto1.nl] INFO: Found listing with ID: NG63197
2026-03-28 05:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NG63197%27 HTTP/1.1" 200 None
2026-03-28 05:01:52 [auto1.nl] INFO: Scrape type for NG63197: 0
2026-03-28 05:01:52 [auto1.nl] INFO: Found listing with ID: KA53212
2026-03-28 05:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KA53212%27 HTTP/1.1" 200 None
2026-03-28 05:01:52 [auto1.nl] INFO: Scrape type for KA53212: 0
2026-03-28 05:01:52 [auto1.nl] INFO: Found listing with ID: UD40907
2026-03-28 05:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UD40907%27 HTTP/1.1" 200 None
2026-03-28 05:01:52 [auto1.nl] INFO: Scrape type for UD40907: 0
2026-03-28 05:01:52 [auto1.nl] INFO: Found listing with ID: NP69601
2026-03-28 05:01:52 [auto1.nl] INFO: Found listing with ID: HC58225
2026-03-28 05:01:52 [auto1.nl] INFO: Found listing with ID: UD56346
2026-03-28 05:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UD56346%27 HTTP/1.1" 200 None
2026-03-28 05:01:52 [auto1.nl] INFO: Scrape type for UD56346: 0
2026-03-28 05:01:52 [auto1.nl] INFO: Found listing with ID: ZA96365
2026-03-28 05:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZA96365%27 HTTP/1.1" 200 None
2026-03-28 05:01:52 [auto1.nl] INFO: Scrape type for ZA96365: 0
2026-03-28 05:01:52 [auto1.nl] INFO: Found listing with ID: VU12203
2026-03-28 05:01:52 [auto1.nl] INFO: Found listing with ID: YR49127
2026-03-28 05:01:52 [auto1.nl] INFO: Found listing with ID: FL63517
2026-03-28 05:01:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:01:53 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:01:53 [auto1.nl] INFO: Channel: 24h | Page: 18 | totalHits: 917 | hits on page: 40
2026-03-28 05:01:53 [auto1.nl] INFO: Found listing with ID: HH96879
2026-03-28 05:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HH96879%27 HTTP/1.1" 200 None
2026-03-28 05:01:53 [auto1.nl] INFO: Scrape type for HH96879: 0
2026-03-28 05:01:53 [auto1.nl] INFO: Found listing with ID: NR15886
2026-03-28 05:01:53 [auto1.nl] INFO: Found listing with ID: WN75862
2026-03-28 05:01:53 [auto1.nl] INFO: Found listing with ID: PN82428
2026-03-28 05:01:53 [auto1.nl] INFO: Found listing with ID: DE05380
2026-03-28 05:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DE05380%27 HTTP/1.1" 200 None
2026-03-28 05:01:53 [auto1.nl] INFO: Scrape type for DE05380: 0
2026-03-28 05:01:53 [auto1.nl] INFO: Found listing with ID: HD17412
2026-03-28 05:01:53 [auto1.nl] INFO: Found listing with ID: RL60639
2026-03-28 05:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RL60639%27 HTTP/1.1" 200 None
2026-03-28 05:01:53 [auto1.nl] INFO: Scrape type for RL60639: 0
2026-03-28 05:01:53 [auto1.nl] INFO: Found listing with ID: VC22580
2026-03-28 05:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VC22580%27 HTTP/1.1" 200 None
2026-03-28 05:01:53 [auto1.nl] INFO: Scrape type for VC22580: 0
2026-03-28 05:01:53 [auto1.nl] INFO: Found listing with ID: EH64896
2026-03-28 05:01:53 [auto1.nl] INFO: Found listing with ID: AC84495
2026-03-28 05:01:53 [auto1.nl] INFO: Found listing with ID: KD36085
2026-03-28 05:01:53 [auto1.nl] INFO: Found listing with ID: GY00070
2026-03-28 05:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GY00070%27 HTTP/1.1" 200 None
2026-03-28 05:01:53 [auto1.nl] INFO: Scrape type for GY00070: 0
2026-03-28 05:01:53 [auto1.nl] INFO: Found listing with ID: WP95967
2026-03-28 05:01:53 [auto1.nl] INFO: Found listing with ID: HR88481
2026-03-28 05:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HR88481%27 HTTP/1.1" 200 None
2026-03-28 05:01:53 [auto1.nl] INFO: Scrape type for HR88481: 0
2026-03-28 05:01:53 [auto1.nl] INFO: Found listing with ID: ML76723
2026-03-28 05:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ML76723%27 HTTP/1.1" 200 None
2026-03-28 05:01:53 [auto1.nl] INFO: Scrape type for ML76723: 0
2026-03-28 05:01:53 [auto1.nl] INFO: Found listing with ID: UJ05110
2026-03-28 05:01:53 [auto1.nl] INFO: Found listing with ID: GN89359
2026-03-28 05:01:53 [auto1.nl] INFO: Found listing with ID: EL29526
2026-03-28 05:01:53 [auto1.nl] INFO: Found listing with ID: FB74313
2026-03-28 05:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FB74313%27 HTTP/1.1" 200 None
2026-03-28 05:01:53 [auto1.nl] INFO: Scrape type for FB74313: 0
2026-03-28 05:01:53 [auto1.nl] INFO: Found listing with ID: JS19868
2026-03-28 05:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JS19868%27 HTTP/1.1" 200 None
2026-03-28 05:01:53 [auto1.nl] INFO: Scrape type for JS19868: 0
2026-03-28 05:01:53 [auto1.nl] INFO: Found listing with ID: TN92622
2026-03-28 05:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TN92622%27 HTTP/1.1" 200 None
2026-03-28 05:01:53 [auto1.nl] INFO: Scrape type for TN92622: 0
2026-03-28 05:01:53 [auto1.nl] INFO: Found listing with ID: NY79842
2026-03-28 05:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NY79842%27 HTTP/1.1" 200 None
2026-03-28 05:01:53 [auto1.nl] INFO: Scrape type for NY79842: 0
2026-03-28 05:01:53 [auto1.nl] INFO: Found listing with ID: LR65933
2026-03-28 05:01:53 [auto1.nl] INFO: Found listing with ID: VJ86590
2026-03-28 05:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VJ86590%27 HTTP/1.1" 200 None
2026-03-28 05:01:53 [auto1.nl] INFO: Scrape type for VJ86590: 0
2026-03-28 05:01:53 [auto1.nl] INFO: Found listing with ID: WE00434
2026-03-28 05:01:53 [auto1.nl] INFO: Found listing with ID: SZ87293
2026-03-28 05:01:53 [auto1.nl] INFO: Found listing with ID: FK48987
2026-03-28 05:01:53 [auto1.nl] INFO: Found listing with ID: NX76865
2026-03-28 05:01:53 [auto1.nl] INFO: Found listing with ID: SM08260
2026-03-28 05:01:53 [auto1.nl] INFO: Found listing with ID: UV82075
2026-03-28 05:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UV82075%27 HTTP/1.1" 200 None
2026-03-28 05:01:53 [auto1.nl] INFO: Scrape type for UV82075: 0
2026-03-28 05:01:53 [auto1.nl] INFO: Found listing with ID: TJ92302
2026-03-28 05:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TJ92302%27 HTTP/1.1" 200 None
2026-03-28 05:01:53 [auto1.nl] INFO: Scrape type for TJ92302: 0
2026-03-28 05:01:53 [auto1.nl] INFO: Found listing with ID: GN05115
2026-03-28 05:01:53 [auto1.nl] INFO: Found listing with ID: PM71197
2026-03-28 05:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PM71197%27 HTTP/1.1" 200 None
2026-03-28 05:01:53 [auto1.nl] INFO: Scrape type for PM71197: 0
2026-03-28 05:01:53 [auto1.nl] INFO: Found listing with ID: RY75066
2026-03-28 05:01:53 [auto1.nl] INFO: Found listing with ID: XY26028
2026-03-28 05:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XY26028%27 HTTP/1.1" 200 None
2026-03-28 05:01:53 [auto1.nl] INFO: Scrape type for XY26028: 0
2026-03-28 05:01:53 [auto1.nl] INFO: Found listing with ID: AZ42388
2026-03-28 05:01:53 [auto1.nl] INFO: Found listing with ID: ZP12059
2026-03-28 05:01:53 [auto1.nl] INFO: Found listing with ID: EY58020
2026-03-28 05:01:53 [auto1.nl] INFO: Found listing with ID: HZ03058
2026-03-28 05:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HZ03058%27 HTTP/1.1" 200 None
2026-03-28 05:01:53 [auto1.nl] INFO: Scrape type for HZ03058: 0
2026-03-28 05:01:53 [auto1.nl] INFO: Found listing with ID: SA79399
2026-03-28 05:01:53 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:01:54 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:01:54 [auto1.nl] INFO: Channel: 24h | Page: 19 | totalHits: 917 | hits on page: 40
2026-03-28 05:01:54 [auto1.nl] INFO: Found listing with ID: GD83498
2026-03-28 05:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GD83498%27 HTTP/1.1" 200 None
2026-03-28 05:01:54 [auto1.nl] INFO: Scrape type for GD83498: 0
2026-03-28 05:01:54 [auto1.nl] INFO: Found listing with ID: JK11532
2026-03-28 05:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JK11532%27 HTTP/1.1" 200 None
2026-03-28 05:01:54 [auto1.nl] INFO: Scrape type for JK11532: 0
2026-03-28 05:01:54 [auto1.nl] INFO: Found listing with ID: HK93829
2026-03-28 05:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HK93829%27 HTTP/1.1" 200 None
2026-03-28 05:01:54 [auto1.nl] INFO: Scrape type for HK93829: 0
2026-03-28 05:01:54 [auto1.nl] INFO: Found listing with ID: RF47261
2026-03-28 05:01:54 [auto1.nl] INFO: Found listing with ID: BY07410
2026-03-28 05:01:54 [auto1.nl] INFO: Found listing with ID: SE62217
2026-03-28 05:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SE62217%27 HTTP/1.1" 200 None
2026-03-28 05:01:54 [auto1.nl] INFO: Scrape type for SE62217: 0
2026-03-28 05:01:54 [auto1.nl] INFO: Found listing with ID: YU38024
2026-03-28 05:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YU38024%27 HTTP/1.1" 200 None
2026-03-28 05:01:54 [auto1.nl] INFO: Scrape type for YU38024: 0
2026-03-28 05:01:54 [auto1.nl] INFO: Found listing with ID: KZ40216
2026-03-28 05:01:54 [auto1.nl] INFO: Found listing with ID: VD19679
2026-03-28 05:01:54 [auto1.nl] INFO: Found listing with ID: KP52767
2026-03-28 05:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KP52767%27 HTTP/1.1" 200 None
2026-03-28 05:01:54 [auto1.nl] INFO: Scrape type for KP52767: 0
2026-03-28 05:01:54 [auto1.nl] INFO: Found listing with ID: FZ85660
2026-03-28 05:01:54 [auto1.nl] INFO: Found listing with ID: KB67971
2026-03-28 05:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KB67971%27 HTTP/1.1" 200 None
2026-03-28 05:01:54 [auto1.nl] INFO: Scrape type for KB67971: 0
2026-03-28 05:01:54 [auto1.nl] INFO: Found listing with ID: EE94160
2026-03-28 05:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EE94160%27 HTTP/1.1" 200 None
2026-03-28 05:01:54 [auto1.nl] INFO: Scrape type for EE94160: 0
2026-03-28 05:01:54 [auto1.nl] INFO: Found listing with ID: JJ92825
2026-03-28 05:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JJ92825%27 HTTP/1.1" 200 None
2026-03-28 05:01:54 [auto1.nl] INFO: Scrape type for JJ92825: 0
2026-03-28 05:01:54 [auto1.nl] INFO: Found listing with ID: VM41876
2026-03-28 05:01:54 [auto1.nl] INFO: Found listing with ID: AA56023
2026-03-28 05:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AA56023%27 HTTP/1.1" 200 None
2026-03-28 05:01:54 [auto1.nl] INFO: Scrape type for AA56023: 0
2026-03-28 05:01:54 [auto1.nl] INFO: Found listing with ID: CP77095
2026-03-28 05:01:54 [auto1.nl] INFO: Found listing with ID: YZ85937
2026-03-28 05:01:54 [auto1.nl] INFO: Found listing with ID: AB34968
2026-03-28 05:01:54 [auto1.nl] INFO: Found listing with ID: UY50656
2026-03-28 05:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UY50656%27 HTTP/1.1" 200 None
2026-03-28 05:01:54 [auto1.nl] INFO: Scrape type for UY50656: 0
2026-03-28 05:01:54 [auto1.nl] INFO: Found listing with ID: FB63193
2026-03-28 05:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FB63193%27 HTTP/1.1" 200 None
2026-03-28 05:01:54 [auto1.nl] INFO: Scrape type for FB63193: 0
2026-03-28 05:01:54 [auto1.nl] INFO: Found listing with ID: HX62169
2026-03-28 05:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HX62169%27 HTTP/1.1" 200 None
2026-03-28 05:01:54 [auto1.nl] INFO: Scrape type for HX62169: 0
2026-03-28 05:01:54 [auto1.nl] INFO: Found listing with ID: HP44065
2026-03-28 05:01:54 [auto1.nl] INFO: Found listing with ID: VB96147
2026-03-28 05:01:54 [auto1.nl] INFO: Found listing with ID: WW80908
2026-03-28 05:01:54 [auto1.nl] INFO: Found listing with ID: HA14742
2026-03-28 05:01:54 [auto1.nl] INFO: Found listing with ID: SB99593
2026-03-28 05:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SB99593%27 HTTP/1.1" 200 None
2026-03-28 05:01:54 [auto1.nl] INFO: Scrape type for SB99593: 0
2026-03-28 05:01:54 [auto1.nl] INFO: Found listing with ID: JD39017
2026-03-28 05:01:54 [auto1.nl] INFO: Found listing with ID: TH29476
2026-03-28 05:01:54 [auto1.nl] INFO: Found listing with ID: JJ87309
2026-03-28 05:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JJ87309%27 HTTP/1.1" 200 None
2026-03-28 05:01:54 [auto1.nl] INFO: Scrape type for JJ87309: 0
2026-03-28 05:01:54 [auto1.nl] INFO: Found listing with ID: GG02103
2026-03-28 05:01:54 [auto1.nl] INFO: Found listing with ID: EY20513
2026-03-28 05:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EY20513%27 HTTP/1.1" 200 None
2026-03-28 05:01:54 [auto1.nl] INFO: Scrape type for EY20513: 0
2026-03-28 05:01:54 [auto1.nl] INFO: Found listing with ID: AE74076
2026-03-28 05:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AE74076%27 HTTP/1.1" 200 None
2026-03-28 05:01:54 [auto1.nl] INFO: Scrape type for AE74076: 0
2026-03-28 05:01:54 [auto1.nl] INFO: Found listing with ID: VA70092
2026-03-28 05:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VA70092%27 HTTP/1.1" 200 None
2026-03-28 05:01:54 [auto1.nl] INFO: Scrape type for VA70092: 0
2026-03-28 05:01:54 [auto1.nl] INFO: Found listing with ID: PY55457
2026-03-28 05:01:54 [auto1.nl] INFO: Found listing with ID: VT73125
2026-03-28 05:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VT73125%27 HTTP/1.1" 200 None
2026-03-28 05:01:54 [auto1.nl] INFO: Scrape type for VT73125: 0
2026-03-28 05:01:54 [auto1.nl] INFO: Found listing with ID: SA65575
2026-03-28 05:01:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SA65575%27 HTTP/1.1" 200 None
2026-03-28 05:01:55 [auto1.nl] INFO: Scrape type for SA65575: 0
2026-03-28 05:01:55 [auto1.nl] INFO: Found listing with ID: PD24155
2026-03-28 05:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PD24155%27 HTTP/1.1" 200 None
2026-03-28 05:01:55 [auto1.nl] INFO: Scrape type for PD24155: 0
2026-03-28 05:01:55 [auto1.nl] INFO: Found listing with ID: GB17984
2026-03-28 05:01:55 [auto1.nl] INFO: Found listing with ID: LH77043
2026-03-28 05:01:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:01:56 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:01:56 [auto1.nl] INFO: Channel: 24h | Page: 20 | totalHits: 917 | hits on page: 40
2026-03-28 05:01:56 [auto1.nl] INFO: Found listing with ID: WS58210
2026-03-28 05:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WS58210%27 HTTP/1.1" 200 None
2026-03-28 05:01:56 [auto1.nl] INFO: Scrape type for WS58210: 0
2026-03-28 05:01:56 [auto1.nl] INFO: Found listing with ID: HS59030
2026-03-28 05:01:56 [auto1.nl] INFO: Found listing with ID: US57687
2026-03-28 05:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27US57687%27 HTTP/1.1" 200 None
2026-03-28 05:01:56 [auto1.nl] INFO: Scrape type for US57687: 0
2026-03-28 05:01:56 [auto1.nl] INFO: Found listing with ID: AV01442
2026-03-28 05:01:56 [auto1.nl] INFO: Found listing with ID: FC64695
2026-03-28 05:01:56 [auto1.nl] INFO: Found listing with ID: RC74760
2026-03-28 05:01:56 [auto1.nl] INFO: Found listing with ID: BU15419
2026-03-28 05:01:56 [auto1.nl] INFO: Found listing with ID: AB05434
2026-03-28 05:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AB05434%27 HTTP/1.1" 200 None
2026-03-28 05:01:56 [auto1.nl] INFO: Scrape type for AB05434: 0
2026-03-28 05:01:56 [auto1.nl] INFO: Found listing with ID: HY50584
2026-03-28 05:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HY50584%27 HTTP/1.1" 200 None
2026-03-28 05:01:56 [auto1.nl] INFO: Scrape type for HY50584: 0
2026-03-28 05:01:56 [auto1.nl] INFO: Found listing with ID: BD38212
2026-03-28 05:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BD38212%27 HTTP/1.1" 200 None
2026-03-28 05:01:56 [auto1.nl] INFO: Scrape type for BD38212: 0
2026-03-28 05:01:56 [auto1.nl] INFO: Found listing with ID: ST70882
2026-03-28 05:01:56 [auto1.nl] INFO: Found listing with ID: LG57021
2026-03-28 05:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LG57021%27 HTTP/1.1" 200 None
2026-03-28 05:01:56 [auto1.nl] INFO: Scrape type for LG57021: 0
2026-03-28 05:01:56 [auto1.nl] INFO: Found listing with ID: DK58919
2026-03-28 05:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DK58919%27 HTTP/1.1" 200 None
2026-03-28 05:01:56 [auto1.nl] INFO: Scrape type for DK58919: 0
2026-03-28 05:01:56 [auto1.nl] INFO: Found listing with ID: AB92284
2026-03-28 05:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AB92284%27 HTTP/1.1" 200 None
2026-03-28 05:01:56 [auto1.nl] INFO: Scrape type for AB92284: 0
2026-03-28 05:01:56 [auto1.nl] INFO: Found listing with ID: EF55872
2026-03-28 05:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EF55872%27 HTTP/1.1" 200 None
2026-03-28 05:01:56 [auto1.nl] INFO: Scrape type for EF55872: 0
2026-03-28 05:01:56 [auto1.nl] INFO: Found listing with ID: ZZ76935
2026-03-28 05:01:56 [auto1.nl] INFO: Found listing with ID: TJ45732
2026-03-28 05:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TJ45732%27 HTTP/1.1" 200 None
2026-03-28 05:01:56 [auto1.nl] INFO: Scrape type for TJ45732: 0
2026-03-28 05:01:56 [auto1.nl] INFO: Found listing with ID: DZ37745
2026-03-28 05:01:56 [auto1.nl] INFO: Found listing with ID: BU16200
2026-03-28 05:01:56 [auto1.nl] INFO: Found listing with ID: GA80832
2026-03-28 05:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GA80832%27 HTTP/1.1" 200 None
2026-03-28 05:01:56 [auto1.nl] INFO: Scrape type for GA80832: 0
2026-03-28 05:01:56 [auto1.nl] INFO: Found listing with ID: NX47084
2026-03-28 05:01:56 [auto1.nl] INFO: Found listing with ID: PG46787
2026-03-28 05:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PG46787%27 HTTP/1.1" 200 None
2026-03-28 05:01:56 [auto1.nl] INFO: Scrape type for PG46787: 0
2026-03-28 05:01:56 [auto1.nl] INFO: Found listing with ID: UT08140
2026-03-28 05:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UT08140%27 HTTP/1.1" 200 None
2026-03-28 05:01:56 [auto1.nl] INFO: Scrape type for UT08140: 0
2026-03-28 05:01:56 [auto1.nl] INFO: Found listing with ID: SY53039
2026-03-28 05:01:56 [auto1.nl] INFO: Found listing with ID: SD33545
2026-03-28 05:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SD33545%27 HTTP/1.1" 200 None
2026-03-28 05:01:56 [auto1.nl] INFO: Scrape type for SD33545: 0
2026-03-28 05:01:56 [auto1.nl] INFO: Found listing with ID: JC35078
2026-03-28 05:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JC35078%27 HTTP/1.1" 200 None
2026-03-28 05:01:56 [auto1.nl] INFO: Scrape type for JC35078: 0
2026-03-28 05:01:56 [auto1.nl] INFO: Found listing with ID: LX89920
2026-03-28 05:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LX89920%27 HTTP/1.1" 200 None
2026-03-28 05:01:56 [auto1.nl] INFO: Scrape type for LX89920: 0
2026-03-28 05:01:56 [auto1.nl] INFO: Found listing with ID: LY14996
2026-03-28 05:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LY14996%27 HTTP/1.1" 200 None
2026-03-28 05:01:56 [auto1.nl] INFO: Scrape type for LY14996: 0
2026-03-28 05:01:56 [auto1.nl] INFO: Found listing with ID: AW03238
2026-03-28 05:01:56 [auto1.nl] INFO: Found listing with ID: CX26987
2026-03-28 05:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CX26987%27 HTTP/1.1" 200 None
2026-03-28 05:01:56 [auto1.nl] INFO: Scrape type for CX26987: 0
2026-03-28 05:01:56 [auto1.nl] INFO: Found listing with ID: YN37403
2026-03-28 05:01:56 [auto1.nl] INFO: Found listing with ID: FU31497
2026-03-28 05:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FU31497%27 HTTP/1.1" 200 None
2026-03-28 05:01:56 [auto1.nl] INFO: Scrape type for FU31497: 0
2026-03-28 05:01:56 [auto1.nl] INFO: Found listing with ID: UC04146
2026-03-28 05:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UC04146%27 HTTP/1.1" 200 None
2026-03-28 05:01:56 [auto1.nl] INFO: Scrape type for UC04146: 0
2026-03-28 05:01:56 [auto1.nl] INFO: Found listing with ID: GN83420
2026-03-28 05:01:56 [auto1.nl] INFO: Found listing with ID: BW44039
2026-03-28 05:01:56 [auto1.nl] INFO: Found listing with ID: FK86795
2026-03-28 05:01:56 [auto1.nl] INFO: Found listing with ID: NV18219
2026-03-28 05:01:56 [auto1.nl] INFO: Found listing with ID: UB37816
2026-03-28 05:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UB37816%27 HTTP/1.1" 200 None
2026-03-28 05:01:56 [auto1.nl] INFO: Scrape type for UB37816: 0
2026-03-28 05:01:56 [auto1.nl] INFO: Found listing with ID: NL65263
2026-03-28 05:01:56 [auto1.nl] INFO: Found listing with ID: GX38555
2026-03-28 05:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GX38555%27 HTTP/1.1" 200 None
2026-03-28 05:01:56 [auto1.nl] INFO: Scrape type for GX38555: 0
2026-03-28 05:01:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:01:57 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:01:57 [auto1.nl] INFO: Channel: 24h | Page: 21 | totalHits: 917 | hits on page: 40
2026-03-28 05:01:57 [auto1.nl] INFO: Found listing with ID: ZL62057
2026-03-28 05:01:57 [auto1.nl] INFO: Found listing with ID: PA07201
2026-03-28 05:01:57 [auto1.nl] INFO: Found listing with ID: WU34213
2026-03-28 05:01:57 [auto1.nl] INFO: Found listing with ID: GP63449
2026-03-28 05:01:57 [auto1.nl] INFO: Found listing with ID: FK39304
2026-03-28 05:01:57 [auto1.nl] INFO: Found listing with ID: RN50601
2026-03-28 05:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RN50601%27 HTTP/1.1" 200 None
2026-03-28 05:01:57 [auto1.nl] INFO: Scrape type for RN50601: 0
2026-03-28 05:01:57 [auto1.nl] INFO: Found listing with ID: XJ87481
2026-03-28 05:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XJ87481%27 HTTP/1.1" 200 None
2026-03-28 05:01:57 [auto1.nl] INFO: Scrape type for XJ87481: 0
2026-03-28 05:01:57 [auto1.nl] INFO: Found listing with ID: TC15988
2026-03-28 05:01:57 [auto1.nl] INFO: Found listing with ID: NL71418
2026-03-28 05:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NL71418%27 HTTP/1.1" 200 None
2026-03-28 05:01:57 [auto1.nl] INFO: Scrape type for NL71418: 0
2026-03-28 05:01:57 [auto1.nl] INFO: Found listing with ID: WK29789
2026-03-28 05:01:57 [auto1.nl] INFO: Found listing with ID: UB57166
2026-03-28 05:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UB57166%27 HTTP/1.1" 200 None
2026-03-28 05:01:57 [auto1.nl] INFO: Scrape type for UB57166: 0
2026-03-28 05:01:57 [auto1.nl] INFO: Found listing with ID: YU82988
2026-03-28 05:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YU82988%27 HTTP/1.1" 200 None
2026-03-28 05:01:57 [auto1.nl] INFO: Scrape type for YU82988: 0
2026-03-28 05:01:57 [auto1.nl] INFO: Found listing with ID: WD65994
2026-03-28 05:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WD65994%27 HTTP/1.1" 200 None
2026-03-28 05:01:57 [auto1.nl] INFO: Scrape type for WD65994: 0
2026-03-28 05:01:57 [auto1.nl] INFO: Found listing with ID: GS47094
2026-03-28 05:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GS47094%27 HTTP/1.1" 200 None
2026-03-28 05:01:57 [auto1.nl] INFO: Scrape type for GS47094: 0
2026-03-28 05:01:57 [auto1.nl] INFO: Found listing with ID: LH66044
2026-03-28 05:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LH66044%27 HTTP/1.1" 200 None
2026-03-28 05:01:57 [auto1.nl] INFO: Scrape type for LH66044: 0
2026-03-28 05:01:57 [auto1.nl] INFO: Found listing with ID: XA85497
2026-03-28 05:01:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XA85497%27 HTTP/1.1" 200 None
2026-03-28 05:01:58 [auto1.nl] INFO: Scrape type for XA85497: 0
2026-03-28 05:01:58 [auto1.nl] INFO: Found listing with ID: CG77801
2026-03-28 05:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CG77801%27 HTTP/1.1" 200 None
2026-03-28 05:01:58 [auto1.nl] INFO: Scrape type for CG77801: 0
2026-03-28 05:01:58 [auto1.nl] INFO: Found listing with ID: YH72796
2026-03-28 05:01:58 [auto1.nl] INFO: Found listing with ID: FE21861
2026-03-28 05:01:58 [auto1.nl] INFO: Found listing with ID: SV00912
2026-03-28 05:01:58 [auto1.nl] INFO: Found listing with ID: BP06390
2026-03-28 05:01:58 [auto1.nl] INFO: Found listing with ID: SV78620
2026-03-28 05:01:58 [auto1.nl] INFO: Found listing with ID: PP29341
2026-03-28 05:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PP29341%27 HTTP/1.1" 200 None
2026-03-28 05:01:58 [auto1.nl] INFO: Scrape type for PP29341: 0
2026-03-28 05:01:58 [auto1.nl] INFO: Found listing with ID: JX11008
2026-03-28 05:01:58 [auto1.nl] INFO: Found listing with ID: YT76844
2026-03-28 05:01:58 [auto1.nl] INFO: Found listing with ID: WR76222
2026-03-28 05:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WR76222%27 HTTP/1.1" 200 None
2026-03-28 05:01:58 [auto1.nl] INFO: Scrape type for WR76222: 0
2026-03-28 05:01:58 [auto1.nl] INFO: Found listing with ID: ME73088
2026-03-28 05:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ME73088%27 HTTP/1.1" 200 None
2026-03-28 05:01:58 [auto1.nl] INFO: Scrape type for ME73088: 0
2026-03-28 05:01:58 [auto1.nl] INFO: Found listing with ID: UJ24113
2026-03-28 05:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UJ24113%27 HTTP/1.1" 200 None
2026-03-28 05:01:58 [auto1.nl] INFO: Scrape type for UJ24113: 0
2026-03-28 05:01:58 [auto1.nl] INFO: Found listing with ID: BC03068
2026-03-28 05:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BC03068%27 HTTP/1.1" 200 None
2026-03-28 05:01:58 [auto1.nl] INFO: Scrape type for BC03068: 0
2026-03-28 05:01:58 [auto1.nl] INFO: Found listing with ID: RC74228
2026-03-28 05:01:58 [auto1.nl] INFO: Found listing with ID: YN14337
2026-03-28 05:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YN14337%27 HTTP/1.1" 200 None
2026-03-28 05:01:58 [auto1.nl] INFO: Scrape type for YN14337: 0
2026-03-28 05:01:58 [auto1.nl] INFO: Found listing with ID: VM29173
2026-03-28 05:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VM29173%27 HTTP/1.1" 200 None
2026-03-28 05:01:58 [auto1.nl] INFO: Scrape type for VM29173: 0
2026-03-28 05:01:58 [auto1.nl] INFO: Found listing with ID: RR80165
2026-03-28 05:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RR80165%27 HTTP/1.1" 200 None
2026-03-28 05:01:58 [auto1.nl] INFO: Scrape type for RR80165: 0
2026-03-28 05:01:58 [auto1.nl] INFO: Found listing with ID: PA43644
2026-03-28 05:01:58 [auto1.nl] INFO: Found listing with ID: NT33284
2026-03-28 05:01:58 [auto1.nl] INFO: Found listing with ID: AX77318
2026-03-28 05:01:58 [auto1.nl] INFO: Found listing with ID: FR61201
2026-03-28 05:01:58 [auto1.nl] INFO: Found listing with ID: ZP69271
2026-03-28 05:01:58 [auto1.nl] INFO: Found listing with ID: FB46775
2026-03-28 05:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FB46775%27 HTTP/1.1" 200 None
2026-03-28 05:01:58 [auto1.nl] INFO: Scrape type for FB46775: 0
2026-03-28 05:01:58 [auto1.nl] INFO: Found listing with ID: LG18300
2026-03-28 05:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LG18300%27 HTTP/1.1" 200 None
2026-03-28 05:01:58 [auto1.nl] INFO: Scrape type for LG18300: 0
2026-03-28 05:01:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:01:59 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:01:59 [auto1.nl] INFO: Channel: 24h | Page: 22 | totalHits: 917 | hits on page: 40
2026-03-28 05:01:59 [auto1.nl] INFO: Found listing with ID: FX92385
2026-03-28 05:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FX92385%27 HTTP/1.1" 200 None
2026-03-28 05:01:59 [auto1.nl] INFO: Scrape type for FX92385: 0
2026-03-28 05:01:59 [auto1.nl] INFO: Found listing with ID: JA96094
2026-03-28 05:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JA96094%27 HTTP/1.1" 200 None
2026-03-28 05:01:59 [auto1.nl] INFO: Scrape type for JA96094: 0
2026-03-28 05:01:59 [auto1.nl] INFO: Found listing with ID: YB51800
2026-03-28 05:01:59 [auto1.nl] INFO: Found listing with ID: XV01386
2026-03-28 05:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XV01386%27 HTTP/1.1" 200 None
2026-03-28 05:01:59 [auto1.nl] INFO: Scrape type for XV01386: 0
2026-03-28 05:01:59 [auto1.nl] INFO: Found listing with ID: DH84557
2026-03-28 05:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DH84557%27 HTTP/1.1" 200 None
2026-03-28 05:01:59 [auto1.nl] INFO: Scrape type for DH84557: 0
2026-03-28 05:01:59 [auto1.nl] INFO: Found listing with ID: WS29354
2026-03-28 05:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WS29354%27 HTTP/1.1" 200 None
2026-03-28 05:01:59 [auto1.nl] INFO: Scrape type for WS29354: 0
2026-03-28 05:01:59 [auto1.nl] INFO: Found listing with ID: CT81231
2026-03-28 05:01:59 [auto1.nl] INFO: Found listing with ID: JN77730
2026-03-28 05:01:59 [auto1.nl] INFO: Found listing with ID: FS82995
2026-03-28 05:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FS82995%27 HTTP/1.1" 200 None
2026-03-28 05:01:59 [auto1.nl] INFO: Scrape type for FS82995: 0
2026-03-28 05:01:59 [auto1.nl] INFO: Found listing with ID: HT40495
2026-03-28 05:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HT40495%27 HTTP/1.1" 200 None
2026-03-28 05:01:59 [auto1.nl] INFO: Scrape type for HT40495: 0
2026-03-28 05:01:59 [auto1.nl] INFO: Found listing with ID: WZ36257
2026-03-28 05:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WZ36257%27 HTTP/1.1" 200 None
2026-03-28 05:01:59 [auto1.nl] INFO: Scrape type for WZ36257: 0
2026-03-28 05:01:59 [auto1.nl] INFO: Found listing with ID: CY67010
2026-03-28 05:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CY67010%27 HTTP/1.1" 200 None
2026-03-28 05:01:59 [auto1.nl] INFO: Scrape type for CY67010: 0
2026-03-28 05:01:59 [auto1.nl] INFO: Found listing with ID: XJ71773
2026-03-28 05:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XJ71773%27 HTTP/1.1" 200 None
2026-03-28 05:01:59 [auto1.nl] INFO: Scrape type for XJ71773: 0
2026-03-28 05:01:59 [auto1.nl] INFO: Found listing with ID: CC90793
2026-03-28 05:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CC90793%27 HTTP/1.1" 200 None
2026-03-28 05:01:59 [auto1.nl] INFO: Scrape type for CC90793: 0
2026-03-28 05:01:59 [auto1.nl] INFO: Found listing with ID: AE06801
2026-03-28 05:01:59 [auto1.nl] INFO: Found listing with ID: VR09113
2026-03-28 05:01:59 [auto1.nl] INFO: Found listing with ID: MW03156
2026-03-28 05:01:59 [auto1.nl] INFO: Found listing with ID: FY76730
2026-03-28 05:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FY76730%27 HTTP/1.1" 200 None
2026-03-28 05:01:59 [auto1.nl] INFO: Scrape type for FY76730: 0
2026-03-28 05:01:59 [auto1.nl] INFO: Found listing with ID: WG27101
2026-03-28 05:01:59 [auto1.nl] INFO: Found listing with ID: AX06352
2026-03-28 05:01:59 [auto1.nl] INFO: Found listing with ID: SL12489
2026-03-28 05:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SL12489%27 HTTP/1.1" 200 None
2026-03-28 05:02:00 [auto1.nl] INFO: Scrape type for SL12489: 0
2026-03-28 05:02:00 [auto1.nl] INFO: Found listing with ID: YE50957
2026-03-28 05:02:00 [auto1.nl] INFO: Found listing with ID: LJ95506
2026-03-28 05:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LJ95506%27 HTTP/1.1" 200 None
2026-03-28 05:02:00 [auto1.nl] INFO: Scrape type for LJ95506: 0
2026-03-28 05:02:00 [auto1.nl] INFO: Found listing with ID: CR43638
2026-03-28 05:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CR43638%27 HTTP/1.1" 200 None
2026-03-28 05:02:00 [auto1.nl] INFO: Scrape type for CR43638: 0
2026-03-28 05:02:00 [auto1.nl] INFO: Found listing with ID: ZD26534
2026-03-28 05:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZD26534%27 HTTP/1.1" 200 None
2026-03-28 05:02:00 [auto1.nl] INFO: Scrape type for ZD26534: 0
2026-03-28 05:02:00 [auto1.nl] INFO: Found listing with ID: EU67961
2026-03-28 05:02:00 [auto1.nl] INFO: Found listing with ID: LZ16255
2026-03-28 05:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LZ16255%27 HTTP/1.1" 200 None
2026-03-28 05:02:00 [auto1.nl] INFO: Scrape type for LZ16255: 0
2026-03-28 05:02:00 [auto1.nl] INFO: Found listing with ID: PK52304
2026-03-28 05:02:00 [auto1.nl] INFO: Found listing with ID: KV65945
2026-03-28 05:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KV65945%27 HTTP/1.1" 200 None
2026-03-28 05:02:00 [auto1.nl] INFO: Scrape type for KV65945: 0
2026-03-28 05:02:00 [auto1.nl] INFO: Found listing with ID: SY05694
2026-03-28 05:02:00 [auto1.nl] INFO: Found listing with ID: ZL63379
2026-03-28 05:02:00 [auto1.nl] INFO: Found listing with ID: HH59485
2026-03-28 05:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HH59485%27 HTTP/1.1" 200 None
2026-03-28 05:02:00 [auto1.nl] INFO: Scrape type for HH59485: 0
2026-03-28 05:02:00 [auto1.nl] INFO: Found listing with ID: SW07946
2026-03-28 05:02:00 [auto1.nl] INFO: Found listing with ID: NF23683
2026-03-28 05:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NF23683%27 HTTP/1.1" 200 None
2026-03-28 05:02:00 [auto1.nl] INFO: Scrape type for NF23683: 0
2026-03-28 05:02:00 [auto1.nl] INFO: Found listing with ID: WH69219
2026-03-28 05:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WH69219%27 HTTP/1.1" 200 None
2026-03-28 05:02:00 [auto1.nl] INFO: Scrape type for WH69219: 0
2026-03-28 05:02:00 [auto1.nl] INFO: Found listing with ID: CK43593
2026-03-28 05:02:00 [auto1.nl] INFO: Found listing with ID: FR68688
2026-03-28 05:02:00 [auto1.nl] INFO: Found listing with ID: XG40529
2026-03-28 05:02:00 [auto1.nl] INFO: Found listing with ID: HK90585
2026-03-28 05:02:00 [auto1.nl] INFO: Found listing with ID: ZX63291
2026-03-28 05:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZX63291%27 HTTP/1.1" 200 None
2026-03-28 05:02:00 [auto1.nl] INFO: Scrape type for ZX63291: 0
2026-03-28 05:02:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:02:01 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:02:01 [auto1.nl] INFO: Channel: 24h | Page: 23 | totalHits: 917 | hits on page: 37
2026-03-28 05:02:01 [auto1.nl] INFO: Found listing with ID: BG94378
2026-03-28 05:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BG94378%27 HTTP/1.1" 200 None
2026-03-28 05:02:01 [auto1.nl] INFO: Scrape type for BG94378: 0
2026-03-28 05:02:01 [auto1.nl] INFO: Found listing with ID: CR31925
2026-03-28 05:02:01 [auto1.nl] INFO: Found listing with ID: BM13348
2026-03-28 05:02:01 [auto1.nl] INFO: Found listing with ID: ZZ44063
2026-03-28 05:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZZ44063%27 HTTP/1.1" 200 None
2026-03-28 05:02:01 [auto1.nl] INFO: Scrape type for ZZ44063: 0
2026-03-28 05:02:01 [auto1.nl] INFO: Found listing with ID: FP18275
2026-03-28 05:02:01 [auto1.nl] INFO: Found listing with ID: DK51310
2026-03-28 05:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DK51310%27 HTTP/1.1" 200 None
2026-03-28 05:02:01 [auto1.nl] INFO: Scrape type for DK51310: 0
2026-03-28 05:02:01 [auto1.nl] INFO: Found listing with ID: BV58634
2026-03-28 05:02:01 [auto1.nl] INFO: Found listing with ID: MD45251
2026-03-28 05:02:01 [auto1.nl] INFO: Found listing with ID: ZC66376
2026-03-28 05:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZC66376%27 HTTP/1.1" 200 None
2026-03-28 05:02:01 [auto1.nl] INFO: Scrape type for ZC66376: 0
2026-03-28 05:02:01 [auto1.nl] INFO: Found listing with ID: RM47540
2026-03-28 05:02:01 [auto1.nl] INFO: Found listing with ID: DZ87358
2026-03-28 05:02:01 [auto1.nl] INFO: Found listing with ID: GN29290
2026-03-28 05:02:01 [auto1.nl] INFO: Found listing with ID: DN96174
2026-03-28 05:02:01 [auto1.nl] INFO: Found listing with ID: TU10821
2026-03-28 05:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TU10821%27 HTTP/1.1" 200 None
2026-03-28 05:02:01 [auto1.nl] INFO: Scrape type for TU10821: 0
2026-03-28 05:02:01 [auto1.nl] INFO: Found listing with ID: BG27703
2026-03-28 05:02:01 [auto1.nl] INFO: Found listing with ID: EB00697
2026-03-28 05:02:01 [auto1.nl] INFO: Found listing with ID: ET49040
2026-03-28 05:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ET49040%27 HTTP/1.1" 200 None
2026-03-28 05:02:01 [auto1.nl] INFO: Scrape type for ET49040: 0
2026-03-28 05:02:01 [auto1.nl] INFO: Found listing with ID: HX39878
2026-03-28 05:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HX39878%27 HTTP/1.1" 200 None
2026-03-28 05:02:01 [auto1.nl] INFO: Scrape type for HX39878: 0
2026-03-28 05:02:01 [auto1.nl] INFO: Found listing with ID: ES69537
2026-03-28 05:02:01 [auto1.nl] INFO: Found listing with ID: WY03082
2026-03-28 05:02:01 [auto1.nl] INFO: Found listing with ID: NH69771
2026-03-28 05:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NH69771%27 HTTP/1.1" 200 None
2026-03-28 05:02:01 [auto1.nl] INFO: Scrape type for NH69771: 0
2026-03-28 05:02:01 [auto1.nl] INFO: Found listing with ID: CJ41969
2026-03-28 05:02:01 [auto1.nl] INFO: Found listing with ID: UF96545
2026-03-28 05:02:01 [auto1.nl] INFO: Found listing with ID: MT73533
2026-03-28 05:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MT73533%27 HTTP/1.1" 200 None
2026-03-28 05:02:01 [auto1.nl] INFO: Scrape type for MT73533: 0
2026-03-28 05:02:01 [auto1.nl] INFO: Found listing with ID: GL61326
2026-03-28 05:02:01 [auto1.nl] INFO: Found listing with ID: ZY76952
2026-03-28 05:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZY76952%27 HTTP/1.1" 200 None
2026-03-28 05:02:01 [auto1.nl] INFO: Scrape type for ZY76952: 0
2026-03-28 05:02:01 [auto1.nl] INFO: Found listing with ID: BZ34461
2026-03-28 05:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BZ34461%27 HTTP/1.1" 200 None
2026-03-28 05:02:01 [auto1.nl] INFO: Scrape type for BZ34461: 0
2026-03-28 05:02:01 [auto1.nl] INFO: Found listing with ID: SY10793
2026-03-28 05:02:01 [auto1.nl] INFO: Found listing with ID: TY61758
2026-03-28 05:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TY61758%27 HTTP/1.1" 200 None
2026-03-28 05:02:01 [auto1.nl] INFO: Scrape type for TY61758: 0
2026-03-28 05:02:01 [auto1.nl] INFO: Found listing with ID: ZK51232
2026-03-28 05:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZK51232%27 HTTP/1.1" 200 None
2026-03-28 05:02:01 [auto1.nl] INFO: Scrape type for ZK51232: 0
2026-03-28 05:02:01 [auto1.nl] INFO: Found listing with ID: EY85081
2026-03-28 05:02:01 [auto1.nl] INFO: Found listing with ID: ML03692
2026-03-28 05:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ML03692%27 HTTP/1.1" 200 None
2026-03-28 05:02:01 [auto1.nl] INFO: Scrape type for ML03692: 0
2026-03-28 05:02:01 [auto1.nl] INFO: Found listing with ID: NV42843
2026-03-28 05:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NV42843%27 HTTP/1.1" 200 None
2026-03-28 05:02:01 [auto1.nl] INFO: Scrape type for NV42843: 0
2026-03-28 05:02:01 [auto1.nl] INFO: Found listing with ID: RP15329
2026-03-28 05:02:01 [auto1.nl] INFO: Found listing with ID: GK86118
2026-03-28 05:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GK86118%27 HTTP/1.1" 200 None
2026-03-28 05:02:01 [auto1.nl] INFO: Scrape type for GK86118: 0
2026-03-28 05:02:01 [auto1.nl] INFO: Found listing with ID: AG89497
2026-03-28 05:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AG89497%27 HTTP/1.1" 200 None
2026-03-28 05:02:01 [auto1.nl] INFO: Scrape type for AG89497: 0
2026-03-28 05:02:01 [auto1.nl] INFO: Found listing with ID: TB82163
2026-03-28 05:02:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 05:02:02 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-28 05:02:02 [auto1.nl] INFO: Channel: 24h | Page: 24 | totalHits: 917 | hits on page: 0
2026-03-28 05:02:02 [scrapy.core.engine] INFO: Closing spider (finished)
2026-03-28 05:02:02 [auto1.nl] INFO: auto1.nl Batch config: batch 1/2
2026-03-28 05:02:02 [auto1.nl] INFO: auto1.nl Crawl ended with reason finished, scrape types: {<ScrapeType.NEW: 1>: 0, <ScrapeType.NEW_DUPLICATE_ID: 4>: 0, <ScrapeType.PRICE_UPDATE: 2>: 0, <ScrapeType.AUCTION_UPDATE: 3>: 0, <ScrapeType.SKIPPED: 0>: 198, <ScrapeType.BATCH_SKIPPED: 5>: 179}
2026-03-28 05:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 05:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20last_price_update_time%20lt%201774242122 HTTP/1.1" 200 None
2026-03-28 05:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='AN64461') HTTP/1.1" 204 0
2026-03-28 05:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='AW17903') HTTP/1.1" 204 0
2026-03-28 05:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='AX56984') HTTP/1.1" 204 0
2026-03-28 05:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='AY98199') HTTP/1.1" 204 0
2026-03-28 05:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='CD30101') HTTP/1.1" 204 0
2026-03-28 05:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='CF07699') HTTP/1.1" 204 0
2026-03-28 05:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='CF89454') HTTP/1.1" 204 0
2026-03-28 05:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='CM25759') HTTP/1.1" 204 0
2026-03-28 05:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='CU50706') HTTP/1.1" 204 0
2026-03-28 05:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='DC18856') HTTP/1.1" 204 0
2026-03-28 05:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='DG80462') HTTP/1.1" 204 0
2026-03-28 05:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='DM49245') HTTP/1.1" 204 0
2026-03-28 05:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='DP56305') HTTP/1.1" 204 0
2026-03-28 05:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='DT15442') HTTP/1.1" 204 0
2026-03-28 05:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='EA41064') HTTP/1.1" 204 0
2026-03-28 05:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='EA73169') HTTP/1.1" 204 0
2026-03-28 05:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='EK39750') HTTP/1.1" 204 0
2026-03-28 05:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='EU79280') HTTP/1.1" 204 0
2026-03-28 05:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='EY89733') HTTP/1.1" 204 0
2026-03-28 05:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='FA90105') HTTP/1.1" 204 0
2026-03-28 05:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='FE99550') HTTP/1.1" 204 0
2026-03-28 05:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='FH48070') HTTP/1.1" 204 0
2026-03-28 05:02:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='FJ93696') HTTP/1.1" 204 0
2026-03-28 05:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='FN62131') HTTP/1.1" 204 0
2026-03-28 05:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='FP36218') HTTP/1.1" 204 0
2026-03-28 05:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='FP83189') HTTP/1.1" 204 0
2026-03-28 05:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='FX03577') HTTP/1.1" 204 0
2026-03-28 05:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='GD82703') HTTP/1.1" 204 0
2026-03-28 05:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='HA27442') HTTP/1.1" 204 0
2026-03-28 05:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='HD64124') HTTP/1.1" 204 0
2026-03-28 05:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='HJ99142') HTTP/1.1" 204 0
2026-03-28 05:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='HV09549') HTTP/1.1" 204 0
2026-03-28 05:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='HY40038') HTTP/1.1" 204 0
2026-03-28 05:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='HY43030') HTTP/1.1" 204 0
2026-03-28 05:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='JR48368') HTTP/1.1" 204 0
2026-03-28 05:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='JW33594') HTTP/1.1" 204 0
2026-03-28 05:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='KB03511') HTTP/1.1" 204 0
2026-03-28 05:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='KB46225') HTTP/1.1" 204 0
2026-03-28 05:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='KX35592') HTTP/1.1" 204 0
2026-03-28 05:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='LA89986') HTTP/1.1" 204 0
2026-03-28 05:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='LC34578') HTTP/1.1" 204 0
2026-03-28 05:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='LD96874') HTTP/1.1" 204 0
2026-03-28 05:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='LG48029') HTTP/1.1" 204 0
2026-03-28 05:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='LK34353') HTTP/1.1" 204 0
2026-03-28 05:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='LR35899') HTTP/1.1" 204 0
2026-03-28 05:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='LV75014') HTTP/1.1" 204 0
2026-03-28 05:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='LV76433') HTTP/1.1" 204 0
2026-03-28 05:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='MT74092') HTTP/1.1" 204 0
2026-03-28 05:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='MX90695') HTTP/1.1" 204 0
2026-03-28 05:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='NA57563') HTTP/1.1" 204 0
2026-03-28 05:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='NC83699') HTTP/1.1" 204 0
2026-03-28 05:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='NE08657') HTTP/1.1" 204 0
2026-03-28 05:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='NG19545') HTTP/1.1" 204 0
2026-03-28 05:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='NT99001') HTTP/1.1" 204 0
2026-03-28 05:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='NV41736') HTTP/1.1" 204 0
2026-03-28 05:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='NY22066') HTTP/1.1" 204 0
2026-03-28 05:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='NZ25239') HTTP/1.1" 204 0
2026-03-28 05:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='PA93170') HTTP/1.1" 204 0
2026-03-28 05:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='PT85838') HTTP/1.1" 204 0
2026-03-28 05:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='RG10386') HTTP/1.1" 204 0
2026-03-28 05:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='RT02836') HTTP/1.1" 204 0
2026-03-28 05:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='RU65214') HTTP/1.1" 204 0
2026-03-28 05:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='SE65923') HTTP/1.1" 204 0
2026-03-28 05:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='SF92689') HTTP/1.1" 204 0
2026-03-28 05:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='SJ90303') HTTP/1.1" 204 0
2026-03-28 05:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='SJ97867') HTTP/1.1" 204 0
2026-03-28 05:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='SR76434') HTTP/1.1" 204 0
2026-03-28 05:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='ST75697') HTTP/1.1" 204 0
2026-03-28 05:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='SW77530') HTTP/1.1" 204 0
2026-03-28 05:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='TA68954') HTTP/1.1" 204 0
2026-03-28 05:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='TK38305') HTTP/1.1" 204 0
2026-03-28 05:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='TP39186') HTTP/1.1" 204 0
2026-03-28 05:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='UA33883') HTTP/1.1" 204 0
2026-03-28 05:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='UD37151') HTTP/1.1" 204 0
2026-03-28 05:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='UF88780') HTTP/1.1" 204 0
2026-03-28 05:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='UK98090') HTTP/1.1" 204 0
2026-03-28 05:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='UN84686') HTTP/1.1" 204 0
2026-03-28 05:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='UW22704') HTTP/1.1" 204 0
2026-03-28 05:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='UX09258') HTTP/1.1" 204 0
2026-03-28 05:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='VF08835') HTTP/1.1" 204 0
2026-03-28 05:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='VF74605') HTTP/1.1" 204 0
2026-03-28 05:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='VW39751') HTTP/1.1" 204 0
2026-03-28 05:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='WB25150') HTTP/1.1" 204 0
2026-03-28 05:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='WD25967') HTTP/1.1" 204 0
2026-03-28 05:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='WJ51746') HTTP/1.1" 204 0
2026-03-28 05:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='WK96940') HTTP/1.1" 204 0
2026-03-28 05:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='WL59335') HTTP/1.1" 204 0
2026-03-28 05:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='WZ67163') HTTP/1.1" 204 0
2026-03-28 05:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='WZ98983') HTTP/1.1" 204 0
2026-03-28 05:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='XJ12783') HTTP/1.1" 204 0
2026-03-28 05:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='XV86839') HTTP/1.1" 204 0
2026-03-28 05:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='XX48435') HTTP/1.1" 204 0
2026-03-28 05:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='XY15741') HTTP/1.1" 204 0
2026-03-28 05:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='YB25892') HTTP/1.1" 204 0
2026-03-28 05:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='YC48313') HTTP/1.1" 204 0
2026-03-28 05:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='YE48044') HTTP/1.1" 204 0
2026-03-28 05:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='YJ93936') HTTP/1.1" 204 0
2026-03-28 05:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='YR04348') HTTP/1.1" 204 0
2026-03-28 05:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='YV35561') HTTP/1.1" 204 0
2026-03-28 05:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='YY31267') HTTP/1.1" 204 0
2026-03-28 05:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='ZG29304') HTTP/1.1" 204 0
2026-03-28 05:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='ZN83149') HTTP/1.1" 204 0
2026-03-28 05:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='ZV61053') HTTP/1.1" 204 0
2026-03-28 05:02:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "DELETE /ScrapedListings(PartitionKey='auto1.nl',RowKey='ZW27303') HTTP/1.1" 204 0
2026-03-28 05:02:04 [scrapy.extensions.feedexport] INFO: Stored jsonlines feed (75 items) in: file:///var/lib/scrapyd/items/sourcing_v2/auto1.nl/task_27_2026-03-28T05_00_00.jl
2026-03-28 05:02:04 [scrapy.statscollectors] INFO: Dumping Scrapy stats:
{'downloader/request_bytes': 76003,
 'downloader/request_count': 28,
 'downloader/request_method_count/GET': 2,
 'downloader/request_method_count/POST': 26,
 'downloader/response_bytes': 4183655,
 'downloader/response_count': 28,
 'downloader/response_status_count/200': 28,
 'elapsed_time_seconds': 116.823193,
 'feedexport/success_count/FileFeedStorage': 1,
 'finish_reason': 'finished',
 'finish_time': datetime.datetime(2026, 3, 28, 5, 2, 3, 930364, tzinfo=datetime.timezone.utc),
 'item_scraped_count': 75,
 'log_count/DEBUG': 1700,
 'log_count/INFO': 2122,
 'memusage/max': 162193408,
 'memusage/startup': 147533824,
 'request_depth_max': 27,
 'response_received_count': 28,
 'scheduler/dequeued': 28,
 'scheduler/dequeued/memory': 28,
 'scheduler/enqueued': 28,
 'scheduler/enqueued/memory': 28,
 'scrape_type/batch_skipped': 474,
 'scrape_type/price_update': 75,
 'scrape_type/skipped': 408,
 'scrapy-zyte-api/429': 0,
 'scrapy-zyte-api/attempts': 28,
 'scrapy-zyte-api/error_ratio': 0.0,
 'scrapy-zyte-api/errors': 0,
 'scrapy-zyte-api/fatal_errors': 0,
 'scrapy-zyte-api/mean_connection_seconds': 2.9815855488912857,
 'scrapy-zyte-api/mean_response_seconds': 3.1012014595326045,
 'scrapy-zyte-api/processed': 28,
 'scrapy-zyte-api/request_args/customHttpRequestHeaders': 28,
 'scrapy-zyte-api/request_args/experimental.requestCookies': 27,
 'scrapy-zyte-api/request_args/experimental.responseCookies': 28,
 'scrapy-zyte-api/request_args/httpRequestBody': 26,
 'scrapy-zyte-api/request_args/httpRequestMethod': 26,
 'scrapy-zyte-api/request_args/httpResponseBody': 28,
 'scrapy-zyte-api/request_args/httpResponseHeaders': 28,
 'scrapy-zyte-api/request_args/sessionContext': 28,
 'scrapy-zyte-api/request_args/url': 28,
 'scrapy-zyte-api/status_codes/200': 28,
 'scrapy-zyte-api/success': 28,
 'scrapy-zyte-api/success_ratio': 1.0,
 'scrapy-zyte-api/throttle_ratio': 0.0,
 'source/items_encountered': 957,
 'source/total_available': 917,
 'start_time': datetime.datetime(2026, 3, 28, 5, 0, 7, 107171, tzinfo=datetime.timezone.utc)}
2026-03-28 05:02:04 [scrapy.core.engine] INFO: Spider closed (finished)
2026-03-28 05:02:04 [asyncio] ERROR: Unclosed client session
client_session: <aiohttp.client.ClientSession object at 0x7f9639fe5810>
2026-03-28 05:02:04 [asyncio] ERROR: Unclosed client session
client_session: <aiohttp.client.ClientSession object at 0x7f9639e83c50>