2026-03-27 12:10:06 [scrapy.utils.log] INFO: Scrapy 2.11.2 started (bot: SourcingV2)
2026-03-27 12:10:06 [scrapy.utils.log] INFO: Versions: lxml 5.2.2.0, libxml2 2.12.6, cssselect 1.2.0, parsel 1.9.1, w3lib 2.1.2, Twisted 24.3.0, Python 3.11.2 (main, Mar 13 2023, 12:18:29) [GCC 12.2.0], pyOpenSSL 24.1.0 (OpenSSL 3.2.1 30 Jan 2024), cryptography 42.0.7, Platform Linux-5.15.0-1098-azure-x86_64-with-glibc2.36
2026-03-27 12:10:06 [auto1.nl] INFO: Batch mode enabled: batch 2/2
2026-03-27 12:10:06 [auto1.nl] INFO: Starting spider auto1.nl
2026-03-27 12:10:06 [scrapy.addons] INFO: Enabled addons:
[]
2026-03-27 12:10:06 [asyncio] DEBUG: Using selector: EpollSelector
2026-03-27 12:10:06 [scrapy.utils.log] DEBUG: Using reactor: twisted.internet.asyncioreactor.AsyncioSelectorReactor
2026-03-27 12:10:06 [scrapy.utils.log] DEBUG: Using asyncio event loop: asyncio.unix_events._UnixSelectorEventLoop
2026-03-27 12:10:06 [scrapy.extensions.telnet] INFO: Telnet Password: 0be9eed17cbc2418
2026-03-27 12:10:06 [scrapy.middleware] INFO: Enabled extensions:
['scrapy.extensions.corestats.CoreStats',
 'scrapy.extensions.telnet.TelnetConsole',
 'scrapy.extensions.memusage.MemoryUsage',
 'scrapy.extensions.feedexport.FeedExporter',
 'scrapy.extensions.logstats.LogStats',
 'scrapy.extensions.closespider.CloseSpider']
2026-03-27 12:10:06 [scrapy.crawler] INFO: Overridden settings:
{'BOT_NAME': 'SourcingV2',
 'CLOSESPIDER_TIMEOUT': 7200,
 'DOWNLOAD_MAXSIZE': 52428800,
 'DOWNLOAD_WARNSIZE': 10485760,
 'FEED_EXPORT_ENCODING': 'utf-8',
 'LOG_FILE': '/var/log/scrapyd/logs/sourcing_v2/auto1.nl/task_28_2026-03-27T12_10_00.log',
 'LOG_FORMATTER': 'crawlers.log_formatter.SourcingLogFormatter',
 'MEMUSAGE_LIMIT_MB': 2048,
 'MEMUSAGE_WARNING_MB': 1536,
 'NEWSPIDER_MODULE': 'spiders',
 'REQUEST_FINGERPRINTER_CLASS': 'scrapy_zyte_api.ScrapyZyteAPIRequestFingerprinter',
 'REQUEST_FINGERPRINTER_IMPLEMENTATION': '2.7',
 'SPIDER_MODULES': ['spiders', 'auth_check'],
 'TWISTED_REACTOR': 'twisted.internet.asyncioreactor.AsyncioSelectorReactor',
 'USER_AGENT': ''}
2026-03-27 12:10:06 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2026-03-27 12:10:06 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2026-03-27 12:10:06 [scrapy.middleware] INFO: Enabled downloader middlewares:
['scrapy.downloadermiddlewares.offsite.OffsiteMiddleware',
 'scrapy.downloadermiddlewares.httpauth.HttpAuthMiddleware',
 'scrapy.downloadermiddlewares.downloadtimeout.DownloadTimeoutMiddleware',
 'scrapy.downloadermiddlewares.defaultheaders.DefaultHeadersMiddleware',
 'scrapy.downloadermiddlewares.useragent.UserAgentMiddleware',
 'scrapy_zyte_api.ScrapyZyteAPIDownloaderMiddleware',
 'scrapy.downloadermiddlewares.retry.RetryMiddleware',
 'scrapy.downloadermiddlewares.redirect.MetaRefreshMiddleware',
 'scrapy.downloadermiddlewares.httpcompression.HttpCompressionMiddleware',
 'scrapy.downloadermiddlewares.redirect.RedirectMiddleware',
 'scrapy.downloadermiddlewares.cookies.CookiesMiddleware',
 'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware',
 'scrapy.downloadermiddlewares.stats.DownloaderStats']
2026-03-27 12:10:06 [crawlers.middlewares.id_gen_middleware] INFO: Setting up IdGenerationMiddleware
2026-03-27 12:10:06 [scrapy.middleware] INFO: Enabled spider middlewares:
['scrapy.spidermiddlewares.httperror.HttpErrorMiddleware',
 'scrapy_zyte_api.ScrapyZyteAPISpiderMiddleware',
 'crawlers.middlewares.monitoring_spider_middleware.MonitoringSpiderMiddleware',
 'scrapy.spidermiddlewares.referer.RefererMiddleware',
 'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware',
 'scrapy.spidermiddlewares.depth.DepthMiddleware',
 'crawlers.middlewares.photo_download_middleware.PhotoDownloadMiddleware',
 'crawlers.middlewares.report_download_middleware.ReportDownloadMiddleware',
 'crawlers.middlewares.id_gen_middleware.IdGenMiddleware']
2026-03-27 12:10:06 [azure.identity._credentials.environment] INFO: Incomplete environment configuration for EnvironmentCredential. These variables are set: AZURE_TENANT_ID, AZURE_CLIENT_ID
2026-03-27 12:10:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-03-27 12:10:06 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2118
2026-03-27 12:10:06 [azure.identity._credentials.chained] INFO: DefaultAzureCredential acquired a token from WorkloadIdentityCredential
2026-03-27 12:10:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxsourcingstorageprod.table.core.windows.net:443
2026-03-27 12:10:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:06 [crawlers.pipelines.translation_pipeline] INFO: Loading translations for language: auto
2026-03-27 12:10:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /Translations()?$filter=PartitionKey%20eq%20%27auto%27%20and%20RowKey%20eq%20%27auto%27 HTTP/1.1" 200 None
2026-03-27 12:10:06 [crawlers.pipelines.item_rules_pipeline] INFO: Setting up ItemRules Pipeline
2026-03-27 12:10:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_location_for_country.json
2026-03-27 12:10:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: damaged_cars_from_auction_title.json
2026-03-27 12:10:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_country.json
2026-03-27 12:10:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_fr.json
2026-03-27 12:10:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_photos.json
2026-03-27 12:10:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: damaged_from_info.json
2026-03-27 12:10:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: makes_not_allowed.json
2026-03-27 12:10:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: not_operable_from_info.json
2026-03-27 12:10:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: makes_models_not_allowed.json
2026-03-27 12:10:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: keywords_from_title.json
2026-03-27 12:10:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: imported_cars.json
2026-03-27 12:10:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_currency.json
2026-03-27 12:10:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_mileage.json
2026-03-27 12:10:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: keywords_from_auction_title.json
2026-03-27 12:10:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_country_of_origin.json
2026-03-27 12:10:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_pt.json
2026-03-27 12:10:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: electric_cars.json
2026-03-27 12:10:06 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_color.json
2026-03-27 12:10:06 [crawlers.pipelines.post_to_api] INFO: Setting up PostToApi Pipeline pointing to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
2026-03-27 12:10:06 [scrapy.middleware] INFO: Enabled item pipelines:
['crawlers.pipelines.translation_pipeline.TranslationPipeline',
 'crawlers.pipelines.item_rules_pipeline.ItemRulesPipeline',
 'crawlers.pipelines.post_to_api.PostToApiPipeline']
2026-03-27 12:10:06 [scrapy.core.engine] INFO: Spider opened
2026-03-27 12:10:06 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2026-03-27 12:10:06 [scrapy.extensions.telnet] INFO: Telnet console listening on 127.0.0.1:6023
2026-03-27 12:10:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 143MiB
2026-03-27 12:10:06 [scrapy-playwright] INFO: Starting download handler
2026-03-27 12:10:06 [scrapy-playwright] INFO: Starting download handler
2026-03-27 12:10:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 12:10:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/home> (referer: None) ['zyte-api']
2026-03-27 12:10:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 12:10:13 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/en/merchant/signin/ajax> (referer: https://www.auto1.com/en/home) ['zyte-api']
2026-03-27 12:10:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 12:10:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/user-token/obtain-token> (referer: https://www.auto1.com/en/merchant/signin/ajax) ['zyte-api']
2026-03-27 12:10:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 12:10:15 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/en/app/user-token/obtain-token) ['zyte-api']
2026-03-27 12:10:15 [auto1.nl] INFO: Channel: 24h | Page: 0 | totalHits: 1060 | hits on page: 40
2026-03-27 12:10:15 [auto1.nl] INFO: Found listing with ID: JJ92825
2026-03-27 12:10:15 [auto1.nl] INFO: Found listing with ID: VM41876
2026-03-27 12:10:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VM41876%27 HTTP/1.1" 200 None
2026-03-27 12:10:15 [auto1.nl] INFO: Scrape type for VM41876: 1
2026-03-27 12:10:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 12:10:15 [auto1.nl] INFO: Found listing with ID: AA56023
2026-03-27 12:10:15 [auto1.nl] INFO: Found listing with ID: CP77095
2026-03-27 12:10:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CP77095%27 HTTP/1.1" 200 None
2026-03-27 12:10:15 [auto1.nl] INFO: Scrape type for CP77095: 1
2026-03-27 12:10:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 12:10:15 [auto1.nl] INFO: Found listing with ID: YZ85937
2026-03-27 12:10:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YZ85937%27 HTTP/1.1" 200 None
2026-03-27 12:10:15 [auto1.nl] INFO: Scrape type for YZ85937: 1
2026-03-27 12:10:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 12:10:15 [auto1.nl] INFO: Found listing with ID: AB34968
2026-03-27 12:10:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AB34968%27 HTTP/1.1" 200 None
2026-03-27 12:10:15 [auto1.nl] INFO: Scrape type for AB34968: 1
2026-03-27 12:10:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 12:10:15 [auto1.nl] INFO: Found listing with ID: UY50656
2026-03-27 12:10:15 [auto1.nl] INFO: Found listing with ID: FB63193
2026-03-27 12:10:15 [auto1.nl] INFO: Found listing with ID: HX62169
2026-03-27 12:10:15 [auto1.nl] INFO: Found listing with ID: DB38176
2026-03-27 12:10:15 [auto1.nl] INFO: Found listing with ID: HP44065
2026-03-27 12:10:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HP44065%27 HTTP/1.1" 200 None
2026-03-27 12:10:15 [auto1.nl] INFO: Scrape type for HP44065: 1
2026-03-27 12:10:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 12:10:15 [auto1.nl] INFO: Found listing with ID: VB96147
2026-03-27 12:10:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VB96147%27 HTTP/1.1" 200 None
2026-03-27 12:10:15 [auto1.nl] INFO: Scrape type for VB96147: 1
2026-03-27 12:10:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 12:10:15 [auto1.nl] INFO: Found listing with ID: YJ25285
2026-03-27 12:10:15 [auto1.nl] INFO: Found listing with ID: WW80908
2026-03-27 12:10:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WW80908%27 HTTP/1.1" 200 None
2026-03-27 12:10:15 [auto1.nl] INFO: Scrape type for WW80908: 2
2026-03-27 12:10:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4160835d-5ef4-5a94-b15c-6729c011c026 with identifier: WW80908
2026-03-27 12:10:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4160835d-5ef4-5a94-b15c-6729c011c026 with scrape type 2
2026-03-27 12:10:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4160835d-5ef4-5a94-b15c-6729c011c026 with scrape type 2
2026-03-27 12:10:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 4160835d-5ef4-5a94-b15c-6729c011c026, identifier: WW80908
2026-03-27 12:10:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 4160835d-5ef4-5a94-b15c-6729c011c026 with identifier: WW80908
2026-03-27 12:10:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-27 12:10:15 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=black HTTP/1.1" 200 None
2026-03-27 12:10:16 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 12:10:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-27 12:10:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-27 12:10:16 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=petrol HTTP/1.1" 200 None
2026-03-27 12:10:16 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 12:10:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-27 12:10:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 4160835d-5ef4-5a94-b15c-6729c011c026 with identifier: WW80908
2026-03-27 12:10:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 4160835d-5ef4-5a94-b15c-6729c011c026 with identifier: WW80908 to the API
2026-03-27 12:10:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 12:10:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 12:10:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-28T16:29:12Z',
 'fuel_type': 'petrol',
 'id': '4160835d-5ef4-5a94-b15c-6729c011c026',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WW80908',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'E-Klasse',
 'odometer': 191966,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-08-14',
 'seller_name': None,
 'title': 'Mercedes-Benz E-Klasse E 200 AMG Line',
 'transmission': 'automatic',
 'trim': 'AMG Line',
 'year': 2017}
2026-03-27 12:10:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WW80908%27 HTTP/1.1" 200 None
2026-03-27 12:10:16 [auto1.nl] INFO: Saving data for WW80908: {'auction_closing_time': 1774715352.0, 'created_time': 1773924229.472728, 'last_price_update_time': 1774613416.576447}
2026-03-27 12:10:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='WW80908') HTTP/1.1" 204 0
2026-03-27 12:10:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 12:10:16 [auto1.nl] INFO: Found listing with ID: HA14742
2026-03-27 12:10:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HA14742%27 HTTP/1.1" 200 None
2026-03-27 12:10:16 [auto1.nl] INFO: Scrape type for HA14742: 1
2026-03-27 12:10:16 [auto1.nl] INFO: Found listing with ID: SB99593
2026-03-27 12:10:16 [auto1.nl] INFO: Found listing with ID: JD39017
2026-03-27 12:10:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JD39017%27 HTTP/1.1" 200 None
2026-03-27 12:10:16 [auto1.nl] INFO: Scrape type for JD39017: 1
2026-03-27 12:10:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 12:10:16 [auto1.nl] INFO: Found listing with ID: TH29476
2026-03-27 12:10:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TH29476%27 HTTP/1.1" 200 None
2026-03-27 12:10:16 [auto1.nl] INFO: Scrape type for TH29476: 2
2026-03-27 12:10:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 46b19869-6a66-5fe2-9ed7-a7e0960a78b4 with identifier: TH29476
2026-03-27 12:10:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 46b19869-6a66-5fe2-9ed7-a7e0960a78b4 with scrape type 2
2026-03-27 12:10:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 46b19869-6a66-5fe2-9ed7-a7e0960a78b4 with scrape type 2
2026-03-27 12:10:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 46b19869-6a66-5fe2-9ed7-a7e0960a78b4, identifier: TH29476
2026-03-27 12:10:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 46b19869-6a66-5fe2-9ed7-a7e0960a78b4 with identifier: TH29476
2026-03-27 12:10:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-27 12:10:16 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=electro HTTP/1.1" 200 None
2026-03-27 12:10:16 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 12:10:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-27 12:10:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 46b19869-6a66-5fe2-9ed7-a7e0960a78b4 with identifier: TH29476
2026-03-27 12:10:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 46b19869-6a66-5fe2-9ed7-a7e0960a78b4 with identifier: TH29476 to the API
2026-03-27 12:10:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 12:10:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 12:10:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 325,
 'expiration_date': '2026-03-28T16:02:15Z',
 'fuel_type': 'electro',
 'id': '46b19869-6a66-5fe2-9ed7-a7e0960a78b4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TH29476',
 'listing': 'auction',
 'make': 'Kia',
 'model': 'EV6',
 'odometer': 163460,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-08-25',
 'seller_name': None,
 'title': 'Kia EV6 electric drive 239 kW GT Line 4WD',
 'transmission': 'automatic',
 'trim': 'GT Line 4WD',
 'year': 2022}
2026-03-27 12:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TH29476%27 HTTP/1.1" 200 None
2026-03-27 12:10:17 [auto1.nl] INFO: Saving data for TH29476: {'auction_closing_time': 1774713735.0, 'created_time': 1773947569.529077, 'last_price_update_time': 1774613417.312027}
2026-03-27 12:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='TH29476') HTTP/1.1" 204 0
2026-03-27 12:10:17 [auto1.nl] INFO: Found listing with ID: JJ87309
2026-03-27 12:10:17 [auto1.nl] INFO: Found listing with ID: GG02103
2026-03-27 12:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GG02103%27 HTTP/1.1" 200 None
2026-03-27 12:10:17 [auto1.nl] INFO: Scrape type for GG02103: 1
2026-03-27 12:10:17 [auto1.nl] INFO: Found listing with ID: EY20513
2026-03-27 12:10:17 [auto1.nl] INFO: Found listing with ID: AE74076
2026-03-27 12:10:17 [auto1.nl] INFO: Found listing with ID: VA70092
2026-03-27 12:10:17 [auto1.nl] INFO: Found listing with ID: PY55457
2026-03-27 12:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PY55457%27 HTTP/1.1" 200 None
2026-03-27 12:10:17 [auto1.nl] INFO: Scrape type for PY55457: 1
2026-03-27 12:10:17 [auto1.nl] INFO: Found listing with ID: VT73125
2026-03-27 12:10:17 [auto1.nl] INFO: Found listing with ID: SA65575
2026-03-27 12:10:17 [auto1.nl] INFO: Found listing with ID: PD24155
2026-03-27 12:10:17 [auto1.nl] INFO: Found listing with ID: GB17984
2026-03-27 12:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GB17984%27 HTTP/1.1" 200 None
2026-03-27 12:10:17 [auto1.nl] INFO: Scrape type for GB17984: 2
2026-03-27 12:10:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 368c6d61-4cbf-56f1-b99f-55218d9b4180 with identifier: GB17984
2026-03-27 12:10:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 368c6d61-4cbf-56f1-b99f-55218d9b4180 with scrape type 2
2026-03-27 12:10:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 368c6d61-4cbf-56f1-b99f-55218d9b4180 with scrape type 2
2026-03-27 12:10:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 368c6d61-4cbf-56f1-b99f-55218d9b4180, identifier: GB17984
2026-03-27 12:10:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 368c6d61-4cbf-56f1-b99f-55218d9b4180 with identifier: GB17984
2026-03-27 12:10:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-27 12:10:17 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=white HTTP/1.1" 200 None
2026-03-27 12:10:17 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 12:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-27 12:10:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 368c6d61-4cbf-56f1-b99f-55218d9b4180 with identifier: GB17984
2026-03-27 12:10:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 368c6d61-4cbf-56f1-b99f-55218d9b4180 with identifier: GB17984 to the API
2026-03-27 12:10:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 12:10:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 12:10:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 68,
 'expiration_date': '2026-03-28T16:52:58Z',
 'fuel_type': 'petrol',
 'id': '368c6d61-4cbf-56f1-b99f-55218d9b4180',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GB17984',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C1',
 'odometer': 97414,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-01-30',
 'seller_name': None,
 'title': 'Citroen C1 1.0 Attraction',
 'transmission': 'manual',
 'trim': 'Attraction',
 'year': 2014}
2026-03-27 12:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GB17984%27 HTTP/1.1" 200 None
2026-03-27 12:10:17 [auto1.nl] INFO: Saving data for GB17984: {'auction_closing_time': 1774716778.0, 'created_time': 1774120272.687396, 'last_price_update_time': 1774613417.909173}
2026-03-27 12:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='GB17984') HTTP/1.1" 204 0
2026-03-27 12:10:18 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 12:10:18 [auto1.nl] INFO: Found listing with ID: LH77043
2026-03-27 12:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LH77043%27 HTTP/1.1" 200 None
2026-03-27 12:10:18 [auto1.nl] INFO: Scrape type for LH77043: 1
2026-03-27 12:10:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 12:10:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HP44065/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 12:10:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AB34968/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 12:10:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YZ85937/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 12:10:18 [auto1.nl] INFO: Found listing with ID: WS58210
2026-03-27 12:10:18 [auto1.nl] INFO: Found listing with ID: HS59030
2026-03-27 12:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HS59030%27 HTTP/1.1" 200 None
2026-03-27 12:10:18 [auto1.nl] INFO: Scrape type for HS59030: 1
2026-03-27 12:10:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 12:10:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 12:10:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CP77095/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 12:10:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 12:10:18 [auto1.nl] INFO: Found listing with ID: US57687
2026-03-27 12:10:18 [auto1.nl] INFO: Found listing with ID: AV01442
2026-03-27 12:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AV01442%27 HTTP/1.1" 200 None
2026-03-27 12:10:18 [auto1.nl] INFO: Scrape type for AV01442: 1
2026-03-27 12:10:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 12:10:18 [auto1.nl] INFO: Found listing with ID: FC64695
2026-03-27 12:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FC64695%27 HTTP/1.1" 200 None
2026-03-27 12:10:18 [auto1.nl] INFO: Scrape type for FC64695: 1
2026-03-27 12:10:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VM41876/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 12:10:18 [auto1.nl] INFO: Found listing with ID: RC74760
2026-03-27 12:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RC74760%27 HTTP/1.1" 200 None
2026-03-27 12:10:18 [auto1.nl] INFO: Scrape type for RC74760: 1
2026-03-27 12:10:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 12:10:18 [auto1.nl] INFO: Found listing with ID: BU15419
2026-03-27 12:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BU15419%27 HTTP/1.1" 200 None
2026-03-27 12:10:18 [auto1.nl] INFO: Scrape type for BU15419: 1
2026-03-27 12:10:18 [auto1.nl] INFO: Channel: 24h | Page: 1 | totalHits: 1060 | hits on page: 40
2026-03-27 12:10:18 [auto1.nl] INFO: Found listing with ID: AB05434
2026-03-27 12:10:18 [auto1.nl] INFO: Found listing with ID: HY50584
2026-03-27 12:10:18 [auto1.nl] INFO: Found listing with ID: BD38212
2026-03-27 12:10:18 [auto1.nl] INFO: Found listing with ID: ST70882
2026-03-27 12:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ST70882%27 HTTP/1.1" 200 None
2026-03-27 12:10:18 [auto1.nl] INFO: Scrape type for ST70882: 1
2026-03-27 12:10:18 [auto1.nl] INFO: Found listing with ID: JJ92825
2026-03-27 12:10:18 [auto1.nl] INFO: Found listing with ID: VM41876
2026-03-27 12:10:18 [scrapy.dupefilters] DEBUG: Filtered duplicate request: <GET https://www.auto1.com/v1/car-details-view/VM41876/cdb8adcc-312b-4040-b112-4a289f3f9b07> - no more duplicates will be shown (see DUPEFILTER_DEBUG to show all duplicates)
2026-03-27 12:10:18 [auto1.nl] INFO: Found listing with ID: AA56023
2026-03-27 12:10:18 [auto1.nl] INFO: Found listing with ID: CP77095
2026-03-27 12:10:18 [auto1.nl] INFO: Found listing with ID: YZ85937
2026-03-27 12:10:18 [auto1.nl] INFO: Found listing with ID: AB34968
2026-03-27 12:10:18 [auto1.nl] INFO: Found listing with ID: UY50656
2026-03-27 12:10:18 [auto1.nl] INFO: Found listing with ID: FB63193
2026-03-27 12:10:18 [auto1.nl] INFO: Found listing with ID: HX62169
2026-03-27 12:10:18 [auto1.nl] INFO: Found listing with ID: DB38176
2026-03-27 12:10:18 [auto1.nl] INFO: Found listing with ID: HP44065
2026-03-27 12:10:18 [auto1.nl] INFO: Found listing with ID: VB96147
2026-03-27 12:10:18 [auto1.nl] INFO: Found listing with ID: YJ25285
2026-03-27 12:10:18 [auto1.nl] INFO: Found listing with ID: WW80908
2026-03-27 12:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WW80908%27 HTTP/1.1" 200 None
2026-03-27 12:10:18 [auto1.nl] INFO: Scrape type for WW80908: 0
2026-03-27 12:10:18 [auto1.nl] INFO: Found listing with ID: HA14742
2026-03-27 12:10:18 [auto1.nl] INFO: Found listing with ID: SB99593
2026-03-27 12:10:18 [auto1.nl] INFO: Found listing with ID: JD39017
2026-03-27 12:10:18 [auto1.nl] INFO: Found listing with ID: TH29476
2026-03-27 12:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TH29476%27 HTTP/1.1" 200 None
2026-03-27 12:10:18 [auto1.nl] INFO: Scrape type for TH29476: 0
2026-03-27 12:10:18 [auto1.nl] INFO: Found listing with ID: JJ87309
2026-03-27 12:10:18 [auto1.nl] INFO: Found listing with ID: GG02103
2026-03-27 12:10:18 [auto1.nl] INFO: Found listing with ID: EY20513
2026-03-27 12:10:18 [auto1.nl] INFO: Found listing with ID: AE74076
2026-03-27 12:10:18 [auto1.nl] INFO: Found listing with ID: VA70092
2026-03-27 12:10:18 [auto1.nl] INFO: Found listing with ID: PY55457
2026-03-27 12:10:18 [auto1.nl] INFO: Found listing with ID: VT73125
2026-03-27 12:10:18 [auto1.nl] INFO: Found listing with ID: SA65575
2026-03-27 12:10:18 [auto1.nl] INFO: Found listing with ID: PD24155
2026-03-27 12:10:18 [auto1.nl] INFO: Found listing with ID: GB17984
2026-03-27 12:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GB17984%27 HTTP/1.1" 200 None
2026-03-27 12:10:18 [auto1.nl] INFO: Scrape type for GB17984: 0
2026-03-27 12:10:18 [auto1.nl] INFO: Found listing with ID: LH77043
2026-03-27 12:10:18 [auto1.nl] INFO: Found listing with ID: WS58210
2026-03-27 12:10:18 [auto1.nl] INFO: Found listing with ID: HS59030
2026-03-27 12:10:18 [auto1.nl] INFO: Found listing with ID: US57687
2026-03-27 12:10:18 [auto1.nl] INFO: Found listing with ID: AV01442
2026-03-27 12:10:18 [auto1.nl] INFO: Found listing with ID: FC64695
2026-03-27 12:10:18 [auto1.nl] INFO: Found listing with ID: RC74760
2026-03-27 12:10:18 [auto1.nl] INFO: Found listing with ID: BU15419
2026-03-27 12:10:18 [auto1.nl] INFO: Found listing with ID: AB05434
2026-03-27 12:10:18 [auto1.nl] INFO: Found listing with ID: HY50584
2026-03-27 12:10:18 [auto1.nl] INFO: Found listing with ID: BD38212
2026-03-27 12:10:18 [auto1.nl] INFO: Found listing with ID: ST70882
2026-03-27 12:10:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VB96147/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 12:10:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 12:10:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HA14742/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 12:10:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 12:10:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/HS59030/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 12:10:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 12:10:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/LH77043/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 12:10:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 12:10:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/JD39017/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 12:10:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 12:10:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/AV01442/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 12:10:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 12:10:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GG02103/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 12:10:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 12:10:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/RC74760/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 12:10:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 12:10:19 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 12:10:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 12:10:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YZ85937> (referer: https://www.auto1.com/v1/car-details-view/YZ85937/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 12:10:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 12:10:19 [auto1.nl] INFO: Channel: 24h | Page: 2 | totalHits: 1060 | hits on page: 40
2026-03-27 12:10:19 [auto1.nl] INFO: Found listing with ID: LG57021
2026-03-27 12:10:19 [auto1.nl] INFO: Found listing with ID: DK58919
2026-03-27 12:10:19 [auto1.nl] INFO: Found listing with ID: AB92284
2026-03-27 12:10:19 [auto1.nl] INFO: Found listing with ID: EF55872
2026-03-27 12:10:19 [auto1.nl] INFO: Found listing with ID: ZZ76935
2026-03-27 12:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZZ76935%27 HTTP/1.1" 200 None
2026-03-27 12:10:19 [auto1.nl] INFO: Scrape type for ZZ76935: 1
2026-03-27 12:10:19 [auto1.nl] INFO: Found listing with ID: TJ45732
2026-03-27 12:10:19 [auto1.nl] INFO: Found listing with ID: DZ37745
2026-03-27 12:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DZ37745%27 HTTP/1.1" 200 None
2026-03-27 12:10:19 [auto1.nl] INFO: Scrape type for DZ37745: 1
2026-03-27 12:10:19 [auto1.nl] INFO: Found listing with ID: BU16200
2026-03-27 12:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BU16200%27 HTTP/1.1" 200 None
2026-03-27 12:10:19 [auto1.nl] INFO: Scrape type for BU16200: 1
2026-03-27 12:10:19 [auto1.nl] INFO: Found listing with ID: NY57976
2026-03-27 12:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NY57976%27 HTTP/1.1" 200 None
2026-03-27 12:10:19 [auto1.nl] INFO: Scrape type for NY57976: 1
2026-03-27 12:10:19 [auto1.nl] INFO: Found listing with ID: GA80832
2026-03-27 12:10:19 [auto1.nl] INFO: Found listing with ID: DA49617
2026-03-27 12:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DA49617%27 HTTP/1.1" 200 None
2026-03-27 12:10:19 [auto1.nl] INFO: Scrape type for DA49617: 1
2026-03-27 12:10:19 [auto1.nl] INFO: Found listing with ID: NX47084
2026-03-27 12:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NX47084%27 HTTP/1.1" 200 None
2026-03-27 12:10:19 [auto1.nl] INFO: Scrape type for NX47084: 2
2026-03-27 12:10:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a95d0e9f-f0c3-5ef4-ae63-03595406ccf4 with identifier: NX47084
2026-03-27 12:10:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a95d0e9f-f0c3-5ef4-ae63-03595406ccf4 with scrape type 2
2026-03-27 12:10:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a95d0e9f-f0c3-5ef4-ae63-03595406ccf4 with scrape type 2
2026-03-27 12:10:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: a95d0e9f-f0c3-5ef4-ae63-03595406ccf4, identifier: NX47084
2026-03-27 12:10:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: a95d0e9f-f0c3-5ef4-ae63-03595406ccf4 with identifier: NX47084
2026-03-27 12:10:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-27 12:10:20 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=blue HTTP/1.1" 200 None
2026-03-27 12:10:20 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 12:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-27 12:10:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-27 12:10:20 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=hybrid HTTP/1.1" 200 None
2026-03-27 12:10:20 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 12:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-27 12:10:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: a95d0e9f-f0c3-5ef4-ae63-03595406ccf4 with identifier: NX47084
2026-03-27 12:10:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: a95d0e9f-f0c3-5ef4-ae63-03595406ccf4 with identifier: NX47084 to the API
2026-03-27 12:10:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 12:10:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 12:10:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 204,
 'expiration_date': '2026-03-28T16:45:54Z',
 'fuel_type': 'hybrid',
 'id': 'a95d0e9f-f0c3-5ef4-ae63-03595406ccf4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NX47084',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A3 Sportback',
 'odometer': 196479,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-12-14',
 'seller_name': None,
 'title': 'Audi A3 Sportback 1.4 TFSI e-tron Sport',
 'transmission': 'automatic',
 'trim': 'Sport',
 'year': 2016}
2026-03-27 12:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NX47084%27 HTTP/1.1" 200 None
2026-03-27 12:10:20 [auto1.nl] INFO: Saving data for NX47084: {'auction_closing_time': 1774716354.0, 'created_time': 1773134904.784466, 'last_price_update_time': 1774613420.78897}
2026-03-27 12:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='NX47084') HTTP/1.1" 204 0
2026-03-27 12:10:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a4119aee-b299-554e-a3e1-8b46b6b38066 with identifier: YZ85937
2026-03-27 12:10:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a4119aee-b299-554e-a3e1-8b46b6b38066 with scrape type 1
2026-03-27 12:10:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item a4119aee-b299-554e-a3e1-8b46b6b38066
2026-03-27 12:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252Fd1%252F0cd189d48170ccc4ca8aeca0f750e844%252Fpa%252FYZ85937_bda375d1e85843ac8ffd196dcdd7d8d4.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:10:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/d1/0cd189d48170ccc4ca8aeca0f750e844/pa/YZ85937_bda375d1e85843ac8ffd196dcdd7d8d4.jpg not downloaded yet
2026-03-27 12:10:20 [auto1.nl] INFO: Found listing with ID: PG46787
2026-03-27 12:10:20 [auto1.nl] INFO: Found listing with ID: UT08140
2026-03-27 12:10:20 [auto1.nl] INFO: Found listing with ID: SY53039
2026-03-27 12:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SY53039%27 HTTP/1.1" 200 None
2026-03-27 12:10:20 [auto1.nl] INFO: Scrape type for SY53039: 1
2026-03-27 12:10:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252Fd1%252F0cd189d48170ccc4ca8aeca0f750e844%252Fpa%252FYZ85937_71f129c30d30234d69d90eeff87b75a7.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:10:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/d1/0cd189d48170ccc4ca8aeca0f750e844/pa/YZ85937_71f129c30d30234d69d90eeff87b75a7.jpg not downloaded yet
2026-03-27 12:10:21 [auto1.nl] INFO: Found listing with ID: SD33545
2026-03-27 12:10:21 [auto1.nl] INFO: Found listing with ID: JC35078
2026-03-27 12:10:21 [auto1.nl] INFO: Found listing with ID: LX89920
2026-03-27 12:10:21 [auto1.nl] INFO: Found listing with ID: LY14996
2026-03-27 12:10:21 [auto1.nl] INFO: Found listing with ID: AW03238
2026-03-27 12:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AW03238%27 HTTP/1.1" 200 None
2026-03-27 12:10:21 [auto1.nl] INFO: Scrape type for AW03238: 2
2026-03-27 12:10:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 70e116a5-0554-5516-8d57-194c4017972d with identifier: AW03238
2026-03-27 12:10:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 70e116a5-0554-5516-8d57-194c4017972d with scrape type 2
2026-03-27 12:10:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 70e116a5-0554-5516-8d57-194c4017972d with scrape type 2
2026-03-27 12:10:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 70e116a5-0554-5516-8d57-194c4017972d, identifier: AW03238
2026-03-27 12:10:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AB34968> (referer: https://www.auto1.com/v1/car-details-view/AB34968/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 12:10:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HP44065> (referer: https://www.auto1.com/v1/car-details-view/HP44065/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 12:10:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ST70882/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 12:10:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 70e116a5-0554-5516-8d57-194c4017972d with identifier: AW03238
2026-03-27 12:10:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 70e116a5-0554-5516-8d57-194c4017972d with identifier: AW03238
2026-03-27 12:10:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 70e116a5-0554-5516-8d57-194c4017972d with identifier: AW03238 to the API
2026-03-27 12:10:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 12:10:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 12:10:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:58:44Z',
 'fuel_type': 'petrol',
 'id': '70e116a5-0554-5516-8d57-194c4017972d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AW03238',
 'listing': 'auction',
 'make': 'Dodge',
 'model': 'Caliber',
 'odometer': 201846,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-01-16',
 'seller_name': None,
 'title': 'Dodge Caliber 1.8 SE',
 'transmission': 'manual',
 'trim': 'SE',
 'year': 2009}
2026-03-27 12:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AW03238%27 HTTP/1.1" 200 None
2026-03-27 12:10:21 [auto1.nl] INFO: Saving data for AW03238: {'auction_closing_time': 1774717124.0, 'created_time': 1773924406.790854, 'last_price_update_time': 1774613421.48696}
2026-03-27 12:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='AW03238') HTTP/1.1" 204 0
2026-03-27 12:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252Fd1%252F0cd189d48170ccc4ca8aeca0f750e844%252Fpa%252FYZ85937_4cbaef11de832fecb13e43c602ec3cff.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:10:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/d1/0cd189d48170ccc4ca8aeca0f750e844/pa/YZ85937_4cbaef11de832fecb13e43c602ec3cff.jpg not downloaded yet
2026-03-27 12:10:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 12:10:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 12:10:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 12:10:21 [auto1.nl] INFO: Found listing with ID: CX26987
2026-03-27 12:10:21 [auto1.nl] INFO: Found listing with ID: YN37403
2026-03-27 12:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YN37403%27 HTTP/1.1" 200 None
2026-03-27 12:10:21 [auto1.nl] INFO: Scrape type for YN37403: 2
2026-03-27 12:10:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 73656187-f35a-5ed4-b942-7a3c94b60356 with identifier: YN37403
2026-03-27 12:10:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 73656187-f35a-5ed4-b942-7a3c94b60356 with scrape type 2
2026-03-27 12:10:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 73656187-f35a-5ed4-b942-7a3c94b60356 with scrape type 2
2026-03-27 12:10:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 73656187-f35a-5ed4-b942-7a3c94b60356, identifier: YN37403
2026-03-27 12:10:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 73656187-f35a-5ed4-b942-7a3c94b60356 with identifier: YN37403
2026-03-27 12:10:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 73656187-f35a-5ed4-b942-7a3c94b60356 with identifier: YN37403
2026-03-27 12:10:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 73656187-f35a-5ed4-b942-7a3c94b60356 with identifier: YN37403 to the API
2026-03-27 12:10:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 12:10:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 12:10:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 132,
 'expiration_date': '2026-03-28T16:15:55Z',
 'fuel_type': 'petrol',
 'id': '73656187-f35a-5ed4-b942-7a3c94b60356',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YN37403',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Grand Scenic',
 'odometer': 155561,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-05-18',
 'seller_name': None,
 'title': 'Renault Grand Scenic 1.2 TCe Energy BOSE Edition',
 'transmission': 'manual',
 'trim': 'BOSE Edition',
 'year': 2015}
2026-03-27 12:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YN37403%27 HTTP/1.1" 200 None
2026-03-27 12:10:21 [auto1.nl] INFO: Saving data for YN37403: {'auction_closing_time': 1774714555.0, 'created_time': 1773688652.373443, 'last_price_update_time': 1774613421.99311}
2026-03-27 12:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='YN37403') HTTP/1.1" 204 0
2026-03-27 12:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252Fd1%252F0cd189d48170ccc4ca8aeca0f750e844%252Fpa%252FYZ85937_5fea4a99d476168e19710e160c2a7def.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:10:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/d1/0cd189d48170ccc4ca8aeca0f750e844/pa/YZ85937_5fea4a99d476168e19710e160c2a7def.jpg not downloaded yet
2026-03-27 12:10:22 [auto1.nl] INFO: Found listing with ID: FU31497
2026-03-27 12:10:22 [auto1.nl] INFO: Found listing with ID: UC04146
2026-03-27 12:10:22 [auto1.nl] INFO: Found listing with ID: GN83420
2026-03-27 12:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GN83420%27 HTTP/1.1" 200 None
2026-03-27 12:10:22 [auto1.nl] INFO: Scrape type for GN83420: 1
2026-03-27 12:10:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1466d57b-48fb-5f7c-bf02-89823f4e64b8 with identifier: AB34968
2026-03-27 12:10:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1466d57b-48fb-5f7c-bf02-89823f4e64b8 with scrape type 1
2026-03-27 12:10:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 1466d57b-48fb-5f7c-bf02-89823f4e64b8
2026-03-27 12:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf4%252Fcd%252Ff4cd5bd4fd7f87eb72d921bd7846eee6%252Fpa%252FAB34968_938053a5b6417a915f147353096307b0.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:10:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/cd/f4cd5bd4fd7f87eb72d921bd7846eee6/pa/AB34968_938053a5b6417a915f147353096307b0.jpg not downloaded yet
2026-03-27 12:10:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fd45af35-8b23-52ea-8cab-b7a8f4c6671d with identifier: HP44065
2026-03-27 12:10:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fd45af35-8b23-52ea-8cab-b7a8f4c6671d with scrape type 1
2026-03-27 12:10:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item fd45af35-8b23-52ea-8cab-b7a8f4c6671d
2026-03-27 12:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd3%252Fa1%252Fd3a17b82ad0d3822b1794a1aeec067b2%252Fpa%252FHP44065_3578026fae4f7171d84a1726acd531f4.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:10:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/a1/d3a17b82ad0d3822b1794a1aeec067b2/pa/HP44065_3578026fae4f7171d84a1726acd531f4.jpg not downloaded yet
2026-03-27 12:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252Fd1%252F0cd189d48170ccc4ca8aeca0f750e844%252Fpa%252FYZ85937_f8adba2f1d870859ad26b67b7e2d0848.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:10:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/d1/0cd189d48170ccc4ca8aeca0f750e844/pa/YZ85937_f8adba2f1d870859ad26b67b7e2d0848.jpg not downloaded yet
2026-03-27 12:10:22 [auto1.nl] INFO: Found listing with ID: BW44039
2026-03-27 12:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BW44039%27 HTTP/1.1" 200 None
2026-03-27 12:10:22 [auto1.nl] INFO: Scrape type for BW44039: 1
2026-03-27 12:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf4%252Fcd%252Ff4cd5bd4fd7f87eb72d921bd7846eee6%252Fpa%252FAB34968_6baf6942e39391b10f6c42ccea3752f6.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:10:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/cd/f4cd5bd4fd7f87eb72d921bd7846eee6/pa/AB34968_6baf6942e39391b10f6c42ccea3752f6.jpg not downloaded yet
2026-03-27 12:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd3%252Fa1%252Fd3a17b82ad0d3822b1794a1aeec067b2%252Fpa%252FHP44065_1f420d20de04fa7f560e89c26591bb69.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:10:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/a1/d3a17b82ad0d3822b1794a1aeec067b2/pa/HP44065_1f420d20de04fa7f560e89c26591bb69.jpg not downloaded yet
2026-03-27 12:10:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VM41876> (referer: https://www.auto1.com/v1/car-details-view/VM41876/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 12:10:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 12:10:22 [auto1.nl] INFO: Found listing with ID: FK86795
2026-03-27 12:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FK86795%27 HTTP/1.1" 200 None
2026-03-27 12:10:22 [auto1.nl] INFO: Scrape type for FK86795: 2
2026-03-27 12:10:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 03f2004a-6343-513b-88d3-4472beba9358 with identifier: FK86795
2026-03-27 12:10:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 03f2004a-6343-513b-88d3-4472beba9358 with scrape type 2
2026-03-27 12:10:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 03f2004a-6343-513b-88d3-4472beba9358 with scrape type 2
2026-03-27 12:10:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 03f2004a-6343-513b-88d3-4472beba9358, identifier: FK86795
2026-03-27 12:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf4%252Fcd%252Ff4cd5bd4fd7f87eb72d921bd7846eee6%252Fpa%252FAB34968_e709553ca7b6fb3917a87c95fb59ba3c.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:10:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/cd/f4cd5bd4fd7f87eb72d921bd7846eee6/pa/AB34968_e709553ca7b6fb3917a87c95fb59ba3c.jpg not downloaded yet
2026-03-27 12:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd3%252Fa1%252Fd3a17b82ad0d3822b1794a1aeec067b2%252Fpa%252FHP44065_ce12d5a88fac635a5936360ca230ab0a.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:10:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/a1/d3a17b82ad0d3822b1794a1aeec067b2/pa/HP44065_ce12d5a88fac635a5936360ca230ab0a.jpg not downloaded yet
2026-03-27 12:10:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 03f2004a-6343-513b-88d3-4472beba9358 with identifier: FK86795
2026-03-27 12:10:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-27 12:10:22 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=green HTTP/1.1" 200 None
2026-03-27 12:10:22 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 12:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-27 12:10:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 03f2004a-6343-513b-88d3-4472beba9358 with identifier: FK86795
2026-03-27 12:10:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 03f2004a-6343-513b-88d3-4472beba9358 with identifier: FK86795 to the API
2026-03-27 12:10:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 12:10:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 12:10:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-28T16:34:26Z',
 'fuel_type': 'petrol',
 'id': '03f2004a-6343-513b-88d3-4472beba9358',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FK86795',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C3 Picasso',
 'odometer': 161711,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-07-01',
 'seller_name': None,
 'title': 'Citroen C3 Picasso 1.6 VTi Exclusive',
 'transmission': 'manual',
 'trim': 'Exclusive',
 'year': 2009}
2026-03-27 12:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FK86795%27 HTTP/1.1" 200 None
2026-03-27 12:10:22 [auto1.nl] INFO: Saving data for FK86795: {'auction_closing_time': 1774715666.0, 'created_time': 1773775072.600569, 'last_price_update_time': 1774613422.7934}
2026-03-27 12:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='FK86795') HTTP/1.1" 204 0
2026-03-27 12:10:22 [auto1.nl] INFO: Found listing with ID: NV18219
2026-03-27 12:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NV18219%27 HTTP/1.1" 200 None
2026-03-27 12:10:22 [auto1.nl] INFO: Scrape type for NV18219: 1
2026-03-27 12:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf4%252Fcd%252Ff4cd5bd4fd7f87eb72d921bd7846eee6%252Fpa%252FAB34968_2b59417b32b09f86f010b6ef2bc2e072.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:10:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/cd/f4cd5bd4fd7f87eb72d921bd7846eee6/pa/AB34968_2b59417b32b09f86f010b6ef2bc2e072.jpg not downloaded yet
2026-03-27 12:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd3%252Fa1%252Fd3a17b82ad0d3822b1794a1aeec067b2%252Fpa%252FHP44065_31f578763c14aeb611ea866ef0c50221.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:10:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/a1/d3a17b82ad0d3822b1794a1aeec067b2/pa/HP44065_31f578763c14aeb611ea866ef0c50221.jpg not downloaded yet
2026-03-27 12:10:22 [auto1.nl] INFO: Found listing with ID: UB37816
2026-03-27 12:10:22 [auto1.nl] INFO: Found listing with ID: NL65263
2026-03-27 12:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NL65263%27 HTTP/1.1" 200 None
2026-03-27 12:10:23 [auto1.nl] INFO: Scrape type for NL65263: 2
2026-03-27 12:10:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dcaeb174-da19-5334-a362-ae689b907208 with identifier: NL65263
2026-03-27 12:10:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dcaeb174-da19-5334-a362-ae689b907208 with scrape type 2
2026-03-27 12:10:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dcaeb174-da19-5334-a362-ae689b907208 with scrape type 2
2026-03-27 12:10:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: dcaeb174-da19-5334-a362-ae689b907208, identifier: NL65263
2026-03-27 12:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf4%252Fcd%252Ff4cd5bd4fd7f87eb72d921bd7846eee6%252Fpa%252FAB34968_53f80ba0422e25d635340307ac1d7b65.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:10:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/cd/f4cd5bd4fd7f87eb72d921bd7846eee6/pa/AB34968_53f80ba0422e25d635340307ac1d7b65.jpg not downloaded yet
2026-03-27 12:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd3%252Fa1%252Fd3a17b82ad0d3822b1794a1aeec067b2%252Fpa%252FHP44065_279dd40f06f3aaa45e23ba2e561b1e0e.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:10:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/a1/d3a17b82ad0d3822b1794a1aeec067b2/pa/HP44065_279dd40f06f3aaa45e23ba2e561b1e0e.jpg not downloaded yet
2026-03-27 12:10:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CP77095> (referer: https://www.auto1.com/v1/car-details-view/CP77095/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 12:10:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7af47009-9baf-5d8b-8363-fd8d084171a4 with identifier: VM41876
2026-03-27 12:10:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7af47009-9baf-5d8b-8363-fd8d084171a4 with scrape type 1
2026-03-27 12:10:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 7af47009-9baf-5d8b-8363-fd8d084171a4
2026-03-27 12:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252F9a%252Fa79a6e2639b3d5ccf951b3b6b6e9e2d8%252Fpa%252FVM41876_47ad6dbadc4facbb2a1b58eeea2780ce.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:10:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/9a/a79a6e2639b3d5ccf951b3b6b6e9e2d8/pa/VM41876_47ad6dbadc4facbb2a1b58eeea2780ce.jpg already downloaded
2026-03-27 12:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252F9a%252Fa79a6e2639b3d5ccf951b3b6b6e9e2d8%252Fpa%252FVM41876_b5db5be285539022b2c02e74f6b29d81.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:10:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/9a/a79a6e2639b3d5ccf951b3b6b6e9e2d8/pa/VM41876_b5db5be285539022b2c02e74f6b29d81.jpg already downloaded
2026-03-27 12:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252F9a%252Fa79a6e2639b3d5ccf951b3b6b6e9e2d8%252Fpa%252FVM41876_bf66c387550dc4cc29f28413215895ab.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:10:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/9a/a79a6e2639b3d5ccf951b3b6b6e9e2d8/pa/VM41876_bf66c387550dc4cc29f28413215895ab.jpg already downloaded
2026-03-27 12:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252F9a%252Fa79a6e2639b3d5ccf951b3b6b6e9e2d8%252Fpa%252FVM41876_4ba92fb19d33e6137ac7f0bf1b30e276.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:10:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/9a/a79a6e2639b3d5ccf951b3b6b6e9e2d8/pa/VM41876_4ba92fb19d33e6137ac7f0bf1b30e276.jpg already downloaded
2026-03-27 12:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252F9a%252Fa79a6e2639b3d5ccf951b3b6b6e9e2d8%252Fpa%252FVM41876_4bef87ee226a9522284847de26911a68.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:10:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/9a/a79a6e2639b3d5ccf951b3b6b6e9e2d8/pa/VM41876_4bef87ee226a9522284847de26911a68.jpg already downloaded
2026-03-27 12:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252F9a%252Fa79a6e2639b3d5ccf951b3b6b6e9e2d8%252Fpa%252FVM41876_4d5ecd4786a25e2ca5333b91360b89cc.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:10:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/9a/a79a6e2639b3d5ccf951b3b6b6e9e2d8/pa/VM41876_4d5ecd4786a25e2ca5333b91360b89cc.jpg already downloaded
2026-03-27 12:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252F9a%252Fa79a6e2639b3d5ccf951b3b6b6e9e2d8%252Fpa%252FVM41876_4ded0211773301d614c5cad13bf8f921.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:10:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/9a/a79a6e2639b3d5ccf951b3b6b6e9e2d8/pa/VM41876_4ded0211773301d614c5cad13bf8f921.jpg already downloaded
2026-03-27 12:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252F9a%252Fa79a6e2639b3d5ccf951b3b6b6e9e2d8%252Fpa%252FVM41876_eb690177379bb646b64f6e630031adfe.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:10:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/9a/a79a6e2639b3d5ccf951b3b6b6e9e2d8/pa/VM41876_eb690177379bb646b64f6e630031adfe.jpg already downloaded
2026-03-27 12:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252F9a%252Fa79a6e2639b3d5ccf951b3b6b6e9e2d8%252Fpa%252FVM41876_dbf2660871d76e6dc3f8ad2b23d60352.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:10:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/9a/a79a6e2639b3d5ccf951b3b6b6e9e2d8/pa/VM41876_dbf2660871d76e6dc3f8ad2b23d60352.jpg already downloaded
2026-03-27 12:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga7%252F9a%252Fa79a6e2639b3d5ccf951b3b6b6e9e2d8%252Fpa%252FVM41876_8371e4ed97353128acab127223eecbb2.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:10:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga7/9a/a79a6e2639b3d5ccf951b3b6b6e9e2d8/pa/VM41876_8371e4ed97353128acab127223eecbb2.jpg already downloaded
2026-03-27 12:10:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 7af47009-9baf-5d8b-8363-fd8d084171a4, identifier: VM41876
2026-03-27 12:10:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: dcaeb174-da19-5334-a362-ae689b907208 with identifier: NL65263
2026-03-27 12:10:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: dcaeb174-da19-5334-a362-ae689b907208 with identifier: NL65263
2026-03-27 12:10:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: dcaeb174-da19-5334-a362-ae689b907208 with identifier: NL65263 to the API
2026-03-27 12:10:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 12:10:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 12:10:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 203,
 'expiration_date': '2026-03-28T16:23:53Z',
 'fuel_type': 'petrol',
 'id': 'dcaeb174-da19-5334-a362-ae689b907208',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NL65263',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Galaxy',
 'odometer': 211385,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-05-02',
 'seller_name': None,
 'title': 'Ford Galaxy 2.0 EcoBoost Titanium',
 'transmission': 'automatic',
 'trim': 'Titanium',
 'year': 2013}
2026-03-27 12:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NL65263%27 HTTP/1.1" 200 None
2026-03-27 12:10:23 [auto1.nl] INFO: Saving data for NL65263: {'auction_closing_time': 1774715033.0, 'created_time': 1773774970.164832, 'last_price_update_time': 1774613423.715218}
2026-03-27 12:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='NL65263') HTTP/1.1" 204 0
2026-03-27 12:10:23 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 12:10:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 7af47009-9baf-5d8b-8363-fd8d084171a4 with identifier: VM41876
2026-03-27 12:10:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-27 12:10:23 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=gray HTTP/1.1" 200 None
2026-03-27 12:10:23 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 12:10:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-27 12:10:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 7af47009-9baf-5d8b-8363-fd8d084171a4 with identifier: VM41876
2026-03-27 12:10:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 7af47009-9baf-5d8b-8363-fd8d084171a4 with identifier: VM41876 to the API
2026-03-27 12:10:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 12:10:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 12:10:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/VM41876>
{'auction_title': '',
 'c_o_2_emission_value': 103,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:33:21Z',
 'fuel_type': 'petrol',
 'id': '7af47009-9baf-5d8b-8363-fd8d084171a4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'RP647V',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VM41876',
 'listing': 'auction',
 'location': 'NL, Oosterhout',
 'make': 'Peugeot',
 'model': '2008',
 'odometer': 109195,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/imga7/9a/a79a6e2639b3d5ccf951b3b6b6e9e2d8/pa/VM41876_47ad6dbadc4facbb2a1b58eeea2780ce.jpg',
                'https://img-pa.auto1.com/imga7/9a/a79a6e2639b3d5ccf951b3b6b6e9e2d8/pa/VM41876_b5db5be285539022b2c02e74f6b29d81.jpg',
                'https://img-pa.auto1.com/imga7/9a/a79a6e2639b3d5ccf951b3b6b6e9e2d8/pa/VM41876_bf66c387550dc4cc29f28413215895ab.jpg',
                'https://img-pa.auto1.com/imga7/9a/a79a6e2639b3d5ccf951b3b6b6e9e2d8/pa/VM41876_4ba92fb19d33e6137ac7f0bf1b30e276.jpg',
                'https://img-pa.auto1.com/imga7/9a/a79a6e2639b3d5ccf951b3b6b6e9e2d8/pa/VM41876_4bef87ee226a9522284847de26911a68.jpg',
                'https://img-pa.auto1.com/imga7/9a/a79a6e2639b3d5ccf951b3b6b6e9e2d8/pa/VM41876_4d5ecd4786a25e2ca5333b91360b89cc.jpg',
                'https://img-pa.auto1.com/imga7/9a/a79a6e2639b3d5ccf951b3b6b6e9e2d8/pa/VM41876_4ded0211773301d614c5cad13bf8f921.jpg',
                'https://img-pa.auto1.com/imga7/9a/a79a6e2639b3d5ccf951b3b6b6e9e2d8/pa/VM41876_eb690177379bb646b64f6e630031adfe.jpg',
                'https://img-pa.auto1.com/imga7/9a/a79a6e2639b3d5ccf951b3b6b6e9e2d8/pa/VM41876_dbf2660871d76e6dc3f8ad2b23d60352.jpg',
                'https://img-pa.auto1.com/imga7/9a/a79a6e2639b3d5ccf951b3b6b6e9e2d8/pa/VM41876_8371e4ed97353128acab127223eecbb2.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7af47009-9baf-5d8b-8363-fd8d084171a4/7af47009-9baf-5d8b-8363-fd8d084171a4_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70360,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga7/9a/a79a6e2639b3d5ccf951b3b6b6e9e2d8/pa/VM41876_47ad6dbadc4facbb2a1b58eeea2780ce.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7af47009-9baf-5d8b-8363-fd8d084171a4/7af47009-9baf-5d8b-8363-fd8d084171a4_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62116,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga7/9a/a79a6e2639b3d5ccf951b3b6b6e9e2d8/pa/VM41876_b5db5be285539022b2c02e74f6b29d81.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7af47009-9baf-5d8b-8363-fd8d084171a4/7af47009-9baf-5d8b-8363-fd8d084171a4_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55120,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga7/9a/a79a6e2639b3d5ccf951b3b6b6e9e2d8/pa/VM41876_bf66c387550dc4cc29f28413215895ab.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7af47009-9baf-5d8b-8363-fd8d084171a4/7af47009-9baf-5d8b-8363-fd8d084171a4_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53082,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga7/9a/a79a6e2639b3d5ccf951b3b6b6e9e2d8/pa/VM41876_4ba92fb19d33e6137ac7f0bf1b30e276.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7af47009-9baf-5d8b-8363-fd8d084171a4/7af47009-9baf-5d8b-8363-fd8d084171a4_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51845,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga7/9a/a79a6e2639b3d5ccf951b3b6b6e9e2d8/pa/VM41876_4bef87ee226a9522284847de26911a68.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7af47009-9baf-5d8b-8363-fd8d084171a4/7af47009-9baf-5d8b-8363-fd8d084171a4_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60046,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga7/9a/a79a6e2639b3d5ccf951b3b6b6e9e2d8/pa/VM41876_4d5ecd4786a25e2ca5333b91360b89cc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7af47009-9baf-5d8b-8363-fd8d084171a4/7af47009-9baf-5d8b-8363-fd8d084171a4_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50346,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga7/9a/a79a6e2639b3d5ccf951b3b6b6e9e2d8/pa/VM41876_4ded0211773301d614c5cad13bf8f921.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7af47009-9baf-5d8b-8363-fd8d084171a4/7af47009-9baf-5d8b-8363-fd8d084171a4_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57131,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga7/9a/a79a6e2639b3d5ccf951b3b6b6e9e2d8/pa/VM41876_eb690177379bb646b64f6e630031adfe.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7af47009-9baf-5d8b-8363-fd8d084171a4/7af47009-9baf-5d8b-8363-fd8d084171a4_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62439,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga7/9a/a79a6e2639b3d5ccf951b3b6b6e9e2d8/pa/VM41876_dbf2660871d76e6dc3f8ad2b23d60352.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7af47009-9baf-5d8b-8363-fd8d084171a4/7af47009-9baf-5d8b-8363-fd8d084171a4_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55181,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga7/9a/a79a6e2639b3d5ccf951b3b6b6e9e2d8/pa/VM41876_8371e4ed97353128acab127223eecbb2.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-01-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 2008 1.2 PureTech Active',
 'transmission': 'manual',
 'trim': 'Active',
 'year': 2018}
2026-03-27 12:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VM41876%27 HTTP/1.1" 200 None
2026-03-27 12:10:24 [auto1.nl] INFO: Saving data for VM41876: {'created_time': 1774613424.217106, 'last_price_update_time': 1774613424.217118, 'auction_closing_time': 1774715601.0}
2026-03-27 12:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='VM41876') HTTP/1.1" 204 0
2026-03-27 12:10:24 [auto1.nl] INFO: Found listing with ID: GX38555
2026-03-27 12:10:24 [auto1.nl] INFO: Found listing with ID: ZL62057
2026-03-27 12:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZL62057%27 HTTP/1.1" 200 None
2026-03-27 12:10:24 [auto1.nl] INFO: Scrape type for ZL62057: 2
2026-03-27 12:10:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1afbdb8d-f03b-51dd-a3be-995c93e4d14e with identifier: ZL62057
2026-03-27 12:10:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1afbdb8d-f03b-51dd-a3be-995c93e4d14e with scrape type 2
2026-03-27 12:10:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1afbdb8d-f03b-51dd-a3be-995c93e4d14e with scrape type 2
2026-03-27 12:10:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 1afbdb8d-f03b-51dd-a3be-995c93e4d14e, identifier: ZL62057
2026-03-27 12:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf4%252Fcd%252Ff4cd5bd4fd7f87eb72d921bd7846eee6%252Fpa%252FAB34968_29db6b243f100d626208c7f785785ab3.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:10:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/cd/f4cd5bd4fd7f87eb72d921bd7846eee6/pa/AB34968_29db6b243f100d626208c7f785785ab3.jpg not downloaded yet
2026-03-27 12:10:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 1afbdb8d-f03b-51dd-a3be-995c93e4d14e with identifier: ZL62057
2026-03-27 12:10:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-27 12:10:24 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=diesel HTTP/1.1" 200 None
2026-03-27 12:10:24 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 12:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-27 12:10:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 1afbdb8d-f03b-51dd-a3be-995c93e4d14e with identifier: ZL62057
2026-03-27 12:10:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 1afbdb8d-f03b-51dd-a3be-995c93e4d14e with identifier: ZL62057 to the API
2026-03-27 12:10:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 12:10:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 12:10:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-28T16:01:44Z',
 'fuel_type': 'diesel',
 'id': '1afbdb8d-f03b-51dd-a3be-995c93e4d14e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZL62057',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Combo',
 'odometer': 202812,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-01-30',
 'seller_name': None,
 'title': 'Opel Combo 1.3 CDTI Kasten L1H1 2,2t',
 'transmission': 'manual',
 'trim': 'Kasten L1H1 2,2t',
 'year': 2017}
2026-03-27 12:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZL62057%27 HTTP/1.1" 200 None
2026-03-27 12:10:24 [auto1.nl] INFO: Saving data for ZL62057: {'auction_closing_time': 1774713704.0, 'created_time': 1773774967.694041, 'last_price_update_time': 1774613424.800784}
2026-03-27 12:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='ZL62057') HTTP/1.1" 204 0
2026-03-27 12:10:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VB96147> (referer: https://www.auto1.com/v1/car-details-view/VB96147/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 12:10:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/LH77043> (referer: https://www.auto1.com/v1/car-details-view/LH77043/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 12:10:24 [auto1.nl] INFO: Found listing with ID: PA07201
2026-03-27 12:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PA07201%27 HTTP/1.1" 200 None
2026-03-27 12:10:24 [auto1.nl] INFO: Scrape type for PA07201: 1
2026-03-27 12:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf4%252Fcd%252Ff4cd5bd4fd7f87eb72d921bd7846eee6%252Fpa%252FAB34968_0f13e352da63b545695dca71e59ddcbe.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:10:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/cd/f4cd5bd4fd7f87eb72d921bd7846eee6/pa/AB34968_0f13e352da63b545695dca71e59ddcbe.jpg not downloaded yet
2026-03-27 12:10:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 12:10:24 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 12:10:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 40f25db6-ecfa-58fb-937a-bac29060adc3 with identifier: CP77095
2026-03-27 12:10:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 40f25db6-ecfa-58fb-937a-bac29060adc3 with scrape type 1
2026-03-27 12:10:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 40f25db6-ecfa-58fb-937a-bac29060adc3
2026-03-27 12:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3b%252F23%252F3b230eaa7f4b53c93143f3539cfef86b%252Fpa%252FCP77095_5d27fa5a32f5f24029065cabd0fbe95c.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:10:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3b/23/3b230eaa7f4b53c93143f3539cfef86b/pa/CP77095_5d27fa5a32f5f24029065cabd0fbe95c.jpg already downloaded
2026-03-27 12:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3b%252F23%252F3b230eaa7f4b53c93143f3539cfef86b%252Fpa%252FCP77095_f15ac70d59b29d45cc00c415261f59da.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:10:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3b/23/3b230eaa7f4b53c93143f3539cfef86b/pa/CP77095_f15ac70d59b29d45cc00c415261f59da.jpg already downloaded
2026-03-27 12:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3b%252F23%252F3b230eaa7f4b53c93143f3539cfef86b%252Fpa%252FCP77095_505eddef3d093cc0ea0fb61c20530d2a.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:10:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3b/23/3b230eaa7f4b53c93143f3539cfef86b/pa/CP77095_505eddef3d093cc0ea0fb61c20530d2a.jpg already downloaded
2026-03-27 12:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3b%252F23%252F3b230eaa7f4b53c93143f3539cfef86b%252Fpa%252FCP77095_4c06e0c5fef32161939aeb61a7629c2b.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:10:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3b/23/3b230eaa7f4b53c93143f3539cfef86b/pa/CP77095_4c06e0c5fef32161939aeb61a7629c2b.jpg already downloaded
2026-03-27 12:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3b%252F23%252F3b230eaa7f4b53c93143f3539cfef86b%252Fpa%252FCP77095_27707274dc823c76c50c45bfc3ba2e41.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:10:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3b/23/3b230eaa7f4b53c93143f3539cfef86b/pa/CP77095_27707274dc823c76c50c45bfc3ba2e41.jpg already downloaded
2026-03-27 12:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3b%252F23%252F3b230eaa7f4b53c93143f3539cfef86b%252Fpa%252FCP77095_9815258e898544dc8dde838ca5929864.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:10:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3b/23/3b230eaa7f4b53c93143f3539cfef86b/pa/CP77095_9815258e898544dc8dde838ca5929864.jpg already downloaded
2026-03-27 12:10:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3b%252F23%252F3b230eaa7f4b53c93143f3539cfef86b%252Fpa%252FCP77095_e89d590f32178dfff281aba057e594df.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:10:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3b/23/3b230eaa7f4b53c93143f3539cfef86b/pa/CP77095_e89d590f32178dfff281aba057e594df.jpg already downloaded
2026-03-27 12:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3b%252F23%252F3b230eaa7f4b53c93143f3539cfef86b%252Fpa%252FCP77095_55caa871bb0b55ee2a154de17e89f930.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:10:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3b/23/3b230eaa7f4b53c93143f3539cfef86b/pa/CP77095_55caa871bb0b55ee2a154de17e89f930.jpg already downloaded
2026-03-27 12:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3b%252F23%252F3b230eaa7f4b53c93143f3539cfef86b%252Fpa%252FCP77095_cbd8fceb718f62cb9637c8e4d1c63c0d.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:10:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3b/23/3b230eaa7f4b53c93143f3539cfef86b/pa/CP77095_cbd8fceb718f62cb9637c8e4d1c63c0d.jpg already downloaded
2026-03-27 12:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3b%252F23%252F3b230eaa7f4b53c93143f3539cfef86b%252Fpa%252FCP77095_2e5eedb6fe430140f8dee49a2fa4ae74.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:10:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3b/23/3b230eaa7f4b53c93143f3539cfef86b/pa/CP77095_2e5eedb6fe430140f8dee49a2fa4ae74.jpg already downloaded
2026-03-27 12:10:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 40f25db6-ecfa-58fb-937a-bac29060adc3, identifier: CP77095
2026-03-27 12:10:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0c/d1/0cd189d48170ccc4ca8aeca0f750e844/pa/YZ85937_bda375d1e85843ac8ffd196dcdd7d8d4.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:10:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0c/d1/0cd189d48170ccc4ca8aeca0f750e844/pa/YZ85937_71f129c30d30234d69d90eeff87b75a7.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:10:25 [auto1.nl] INFO: Found listing with ID: WU34213
2026-03-27 12:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WU34213%27 HTTP/1.1" 200 None
2026-03-27 12:10:25 [auto1.nl] INFO: Scrape type for WU34213: 1
2026-03-27 12:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf4%252Fcd%252Ff4cd5bd4fd7f87eb72d921bd7846eee6%252Fpa%252FAB34968_5db592d1c004482386d7e883e392da30.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:10:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/cd/f4cd5bd4fd7f87eb72d921bd7846eee6/pa/AB34968_5db592d1c004482386d7e883e392da30.jpg not downloaded yet
2026-03-27 12:10:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 40f25db6-ecfa-58fb-937a-bac29060adc3 with identifier: CP77095
2026-03-27 12:10:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 40f25db6-ecfa-58fb-937a-bac29060adc3 with identifier: CP77095
2026-03-27 12:10:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 40f25db6-ecfa-58fb-937a-bac29060adc3 with identifier: CP77095 to the API
2026-03-27 12:10:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 12:10:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 12:10:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/CP77095>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'engine_horse_power': 101,
 'expiration_date': '2026-03-28T16:11:36Z',
 'fuel_type': 'petrol',
 'id': '40f25db6-ecfa-58fb-937a-bac29060adc3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'H832LN',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CP77095',
 'listing': 'auction',
 'location': 'NL, Oosterhout',
 'make': 'Renault',
 'model': 'Clio',
 'odometer': 36765,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img3b/23/3b230eaa7f4b53c93143f3539cfef86b/pa/CP77095_5d27fa5a32f5f24029065cabd0fbe95c.jpg',
                'https://img-pa.auto1.com/img3b/23/3b230eaa7f4b53c93143f3539cfef86b/pa/CP77095_f15ac70d59b29d45cc00c415261f59da.jpg',
                'https://img-pa.auto1.com/img3b/23/3b230eaa7f4b53c93143f3539cfef86b/pa/CP77095_505eddef3d093cc0ea0fb61c20530d2a.jpg',
                'https://img-pa.auto1.com/img3b/23/3b230eaa7f4b53c93143f3539cfef86b/pa/CP77095_4c06e0c5fef32161939aeb61a7629c2b.jpg',
                'https://img-pa.auto1.com/img3b/23/3b230eaa7f4b53c93143f3539cfef86b/pa/CP77095_27707274dc823c76c50c45bfc3ba2e41.jpg',
                'https://img-pa.auto1.com/img3b/23/3b230eaa7f4b53c93143f3539cfef86b/pa/CP77095_9815258e898544dc8dde838ca5929864.jpg',
                'https://img-pa.auto1.com/img3b/23/3b230eaa7f4b53c93143f3539cfef86b/pa/CP77095_e89d590f32178dfff281aba057e594df.jpg',
                'https://img-pa.auto1.com/img3b/23/3b230eaa7f4b53c93143f3539cfef86b/pa/CP77095_55caa871bb0b55ee2a154de17e89f930.jpg',
                'https://img-pa.auto1.com/img3b/23/3b230eaa7f4b53c93143f3539cfef86b/pa/CP77095_cbd8fceb718f62cb9637c8e4d1c63c0d.jpg',
                'https://img-pa.auto1.com/img3b/23/3b230eaa7f4b53c93143f3539cfef86b/pa/CP77095_2e5eedb6fe430140f8dee49a2fa4ae74.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40f25db6-ecfa-58fb-937a-bac29060adc3/40f25db6-ecfa-58fb-937a-bac29060adc3_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2123707,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img3b/23/3b230eaa7f4b53c93143f3539cfef86b/pa/CP77095_5d27fa5a32f5f24029065cabd0fbe95c.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40f25db6-ecfa-58fb-937a-bac29060adc3/40f25db6-ecfa-58fb-937a-bac29060adc3_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57742,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3b/23/3b230eaa7f4b53c93143f3539cfef86b/pa/CP77095_f15ac70d59b29d45cc00c415261f59da.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40f25db6-ecfa-58fb-937a-bac29060adc3/40f25db6-ecfa-58fb-937a-bac29060adc3_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75461,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3b/23/3b230eaa7f4b53c93143f3539cfef86b/pa/CP77095_505eddef3d093cc0ea0fb61c20530d2a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40f25db6-ecfa-58fb-937a-bac29060adc3/40f25db6-ecfa-58fb-937a-bac29060adc3_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2098240,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img3b/23/3b230eaa7f4b53c93143f3539cfef86b/pa/CP77095_4c06e0c5fef32161939aeb61a7629c2b.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40f25db6-ecfa-58fb-937a-bac29060adc3/40f25db6-ecfa-58fb-937a-bac29060adc3_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2194578,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img3b/23/3b230eaa7f4b53c93143f3539cfef86b/pa/CP77095_27707274dc823c76c50c45bfc3ba2e41.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40f25db6-ecfa-58fb-937a-bac29060adc3/40f25db6-ecfa-58fb-937a-bac29060adc3_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2356495,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img3b/23/3b230eaa7f4b53c93143f3539cfef86b/pa/CP77095_9815258e898544dc8dde838ca5929864.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40f25db6-ecfa-58fb-937a-bac29060adc3/40f25db6-ecfa-58fb-937a-bac29060adc3_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2114668,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img3b/23/3b230eaa7f4b53c93143f3539cfef86b/pa/CP77095_e89d590f32178dfff281aba057e594df.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40f25db6-ecfa-58fb-937a-bac29060adc3/40f25db6-ecfa-58fb-937a-bac29060adc3_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 93509,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3b/23/3b230eaa7f4b53c93143f3539cfef86b/pa/CP77095_55caa871bb0b55ee2a154de17e89f930.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40f25db6-ecfa-58fb-937a-bac29060adc3/40f25db6-ecfa-58fb-937a-bac29060adc3_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2081887,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img3b/23/3b230eaa7f4b53c93143f3539cfef86b/pa/CP77095_cbd8fceb718f62cb9637c8e4d1c63c0d.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_40f25db6-ecfa-58fb-937a-bac29060adc3/40f25db6-ecfa-58fb-937a-bac29060adc3_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2270220,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img3b/23/3b230eaa7f4b53c93143f3539cfef86b/pa/CP77095_2e5eedb6fe430140f8dee49a2fa4ae74.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-03-08',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Renault Clio 1.0 TCe Intens',
 'transmission': 'manual',
 'trim': 'Intens',
 'year': 2020}
2026-03-27 12:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CP77095%27 HTTP/1.1" 200 None
2026-03-27 12:10:25 [auto1.nl] INFO: Saving data for CP77095: {'created_time': 1774613425.507735, 'last_price_update_time': 1774613425.507745, 'auction_closing_time': 1774714296.0}
2026-03-27 12:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='CP77095') HTTP/1.1" 204 0
2026-03-27 12:10:25 [auto1.nl] INFO: Found listing with ID: GP63449
2026-03-27 12:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GP63449%27 HTTP/1.1" 200 None
2026-03-27 12:10:25 [auto1.nl] INFO: Scrape type for GP63449: 1
2026-03-27 12:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf4%252Fcd%252Ff4cd5bd4fd7f87eb72d921bd7846eee6%252Fpa%252FAB34968_5f42967f039868ad185256127b068fb9.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:10:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/cd/f4cd5bd4fd7f87eb72d921bd7846eee6/pa/AB34968_5f42967f039868ad185256127b068fb9.jpg not downloaded yet
2026-03-27 12:10:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0c/d1/0cd189d48170ccc4ca8aeca0f750e844/pa/YZ85937_f8adba2f1d870859ad26b67b7e2d0848.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:10:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 155d186a-c2a1-57fd-8f5b-08aefda5e6e2 with identifier: VB96147
2026-03-27 12:10:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 155d186a-c2a1-57fd-8f5b-08aefda5e6e2 with scrape type 1
2026-03-27 12:10:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 155d186a-c2a1-57fd-8f5b-08aefda5e6e2
2026-03-27 12:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252F78%252Fcf78ad1dea6fc4cefaf484d694378666%252Fpa%252FVB96147_218ccf08ed0ce88ba5b1fe209026ae96.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:10:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/78/cf78ad1dea6fc4cefaf484d694378666/pa/VB96147_218ccf08ed0ce88ba5b1fe209026ae96.jpg not downloaded yet
2026-03-27 12:10:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8f3583f6-dcea-5498-a04b-38b00a571276 with identifier: LH77043
2026-03-27 12:10:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8f3583f6-dcea-5498-a04b-38b00a571276 with scrape type 1
2026-03-27 12:10:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 8f3583f6-dcea-5498-a04b-38b00a571276
2026-03-27 12:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252F9f%252F7b9f80bc8f345fe1b730f518c0d28032%252Fpa%252FLH77043_5b61683bebccb8bb26d84f7ba25d7b61.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:10:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/9f/7b9f80bc8f345fe1b730f518c0d28032/pa/LH77043_5b61683bebccb8bb26d84f7ba25d7b61.jpg not downloaded yet
2026-03-27 12:10:25 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-03-27 12:10:25 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-03-27 12:10:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:10:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7cfdf89450>
2026-03-27 12:10:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:10:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-03-27 12:10:25 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2107
2026-03-27 12:10:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-03-27 12:10:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:10:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:10:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a4119aee-b299-554e-a3e1-8b46b6b38066/a4119aee-b299-554e-a3e1-8b46b6b38066_image_0.jpg HTTP/1.1" 201 0
2026-03-27 12:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252Fd1%252F0cd189d48170ccc4ca8aeca0f750e844%252Fpa%252FYZ85937_bda375d1e85843ac8ffd196dcdd7d8d4.jpg') HTTP/1.1" 204 0
2026-03-27 12:10:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/d1/0cd189d48170ccc4ca8aeca0f750e844/pa/YZ85937_bda375d1e85843ac8ffd196dcdd7d8d4.jpg saved to cache
2026-03-27 12:10:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a4119aee-b299-554e-a3e1-8b46b6b38066
2026-03-27 12:10:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:10:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7cfcd98f10>
2026-03-27 12:10:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:10:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:10:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:10:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a4119aee-b299-554e-a3e1-8b46b6b38066/a4119aee-b299-554e-a3e1-8b46b6b38066_image_1.jpg HTTP/1.1" 201 0
2026-03-27 12:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252Fd1%252F0cd189d48170ccc4ca8aeca0f750e844%252Fpa%252FYZ85937_71f129c30d30234d69d90eeff87b75a7.jpg') HTTP/1.1" 204 0
2026-03-27 12:10:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/d1/0cd189d48170ccc4ca8aeca0f750e844/pa/YZ85937_71f129c30d30234d69d90eeff87b75a7.jpg saved to cache
2026-03-27 12:10:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a4119aee-b299-554e-a3e1-8b46b6b38066
2026-03-27 12:10:26 [auto1.nl] INFO: Found listing with ID: FK39304
2026-03-27 12:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FK39304%27 HTTP/1.1" 200 None
2026-03-27 12:10:26 [auto1.nl] INFO: Scrape type for FK39304: 1
2026-03-27 12:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgf4%252Fcd%252Ff4cd5bd4fd7f87eb72d921bd7846eee6%252Fpa%252FAB34968_e54430657cea3ffdbf6e8e6b61f6cb25.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:10:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/cd/f4cd5bd4fd7f87eb72d921bd7846eee6/pa/AB34968_e54430657cea3ffdbf6e8e6b61f6cb25.jpg not downloaded yet
2026-03-27 12:10:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf4/cd/f4cd5bd4fd7f87eb72d921bd7846eee6/pa/AB34968_0f13e352da63b545695dca71e59ddcbe.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252F78%252Fcf78ad1dea6fc4cefaf484d694378666%252Fpa%252FVB96147_49233ccd68fe7eb119d2353765755c53.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:10:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/78/cf78ad1dea6fc4cefaf484d694378666/pa/VB96147_49233ccd68fe7eb119d2353765755c53.jpg not downloaded yet
2026-03-27 12:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252F9f%252F7b9f80bc8f345fe1b730f518c0d28032%252Fpa%252FLH77043_a6cea7e13ce62ee0664c526cbde54211.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:10:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/9f/7b9f80bc8f345fe1b730f518c0d28032/pa/LH77043_a6cea7e13ce62ee0664c526cbde54211.jpg not downloaded yet
2026-03-27 12:10:26 [auto1.nl] INFO: Found listing with ID: RN50601
2026-03-27 12:10:26 [auto1.nl] INFO: Found listing with ID: XJ87481
2026-03-27 12:10:26 [auto1.nl] INFO: Found listing with ID: NL71418
2026-03-27 12:10:26 [auto1.nl] INFO: Found listing with ID: TC15988
2026-03-27 12:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TC15988%27 HTTP/1.1" 200 None
2026-03-27 12:10:26 [auto1.nl] INFO: Scrape type for TC15988: 1
2026-03-27 12:10:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:10:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7cfcdadc10>
2026-03-27 12:10:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:10:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:10:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:10:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a4119aee-b299-554e-a3e1-8b46b6b38066/a4119aee-b299-554e-a3e1-8b46b6b38066_image_4.jpg HTTP/1.1" 201 0
2026-03-27 12:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252Fd1%252F0cd189d48170ccc4ca8aeca0f750e844%252Fpa%252FYZ85937_f8adba2f1d870859ad26b67b7e2d0848.jpg') HTTP/1.1" 204 0
2026-03-27 12:10:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/d1/0cd189d48170ccc4ca8aeca0f750e844/pa/YZ85937_f8adba2f1d870859ad26b67b7e2d0848.jpg saved to cache
2026-03-27 12:10:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a4119aee-b299-554e-a3e1-8b46b6b38066
2026-03-27 12:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252F78%252Fcf78ad1dea6fc4cefaf484d694378666%252Fpa%252FVB96147_732509f992dbd8604d48d956b674d3b0.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:10:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/78/cf78ad1dea6fc4cefaf484d694378666/pa/VB96147_732509f992dbd8604d48d956b674d3b0.jpg not downloaded yet
2026-03-27 12:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252F9f%252F7b9f80bc8f345fe1b730f518c0d28032%252Fpa%252FLH77043_86be180875496c00361e0601a1ae771b.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:10:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/9f/7b9f80bc8f345fe1b730f518c0d28032/pa/LH77043_86be180875496c00361e0601a1ae771b.jpg not downloaded yet
2026-03-27 12:10:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf4/cd/f4cd5bd4fd7f87eb72d921bd7846eee6/pa/AB34968_5db592d1c004482386d7e883e392da30.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252F78%252Fcf78ad1dea6fc4cefaf484d694378666%252Fpa%252FVB96147_94c7a8cfd3409704cf957a13ce72e881.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:10:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/78/cf78ad1dea6fc4cefaf484d694378666/pa/VB96147_94c7a8cfd3409704cf957a13ce72e881.jpg not downloaded yet
2026-03-27 12:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252F9f%252F7b9f80bc8f345fe1b730f518c0d28032%252Fpa%252FLH77043_d50d1e6f42ddc146dfc3c9273d7200fa.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:10:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/9f/7b9f80bc8f345fe1b730f518c0d28032/pa/LH77043_d50d1e6f42ddc146dfc3c9273d7200fa.jpg not downloaded yet
2026-03-27 12:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252F78%252Fcf78ad1dea6fc4cefaf484d694378666%252Fpa%252FVB96147_1b7ef855b9e5a65ae2db95de96f86f8d.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:10:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/78/cf78ad1dea6fc4cefaf484d694378666/pa/VB96147_1b7ef855b9e5a65ae2db95de96f86f8d.jpg not downloaded yet
2026-03-27 12:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252F9f%252F7b9f80bc8f345fe1b730f518c0d28032%252Fpa%252FLH77043_3b06c00db4ab111cc59cdf2c10308c57.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:10:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/9f/7b9f80bc8f345fe1b730f518c0d28032/pa/LH77043_3b06c00db4ab111cc59cdf2c10308c57.jpg not downloaded yet
2026-03-27 12:10:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:10:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7cfcdba350>
2026-03-27 12:10:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:10:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:10:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:10:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1466d57b-48fb-5f7c-bf02-89823f4e64b8/1466d57b-48fb-5f7c-bf02-89823f4e64b8_image_6.jpg HTTP/1.1" 201 0
2026-03-27 12:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf4%252Fcd%252Ff4cd5bd4fd7f87eb72d921bd7846eee6%252Fpa%252FAB34968_0f13e352da63b545695dca71e59ddcbe.jpg') HTTP/1.1" 204 0
2026-03-27 12:10:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/cd/f4cd5bd4fd7f87eb72d921bd7846eee6/pa/AB34968_0f13e352da63b545695dca71e59ddcbe.jpg saved to cache
2026-03-27 12:10:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 1466d57b-48fb-5f7c-bf02-89823f4e64b8
2026-03-27 12:10:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7b/9f/7b9f80bc8f345fe1b730f518c0d28032/pa/LH77043_86be180875496c00361e0601a1ae771b.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252F9f%252F7b9f80bc8f345fe1b730f518c0d28032%252Fpa%252FLH77043_350a7a84a7cd1bf9aec4b43f8f748c0d.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:10:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/9f/7b9f80bc8f345fe1b730f518c0d28032/pa/LH77043_350a7a84a7cd1bf9aec4b43f8f748c0d.jpg not downloaded yet
2026-03-27 12:10:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf4/cd/f4cd5bd4fd7f87eb72d921bd7846eee6/pa/AB34968_e54430657cea3ffdbf6e8e6b61f6cb25.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:10:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/AV01442> (referer: https://www.auto1.com/v1/car-details-view/AV01442/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 12:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252F9f%252F7b9f80bc8f345fe1b730f518c0d28032%252Fpa%252FLH77043_9b39fe55e4538c566f7c1493867cbfb2.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:10:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/9f/7b9f80bc8f345fe1b730f518c0d28032/pa/LH77043_9b39fe55e4538c566f7c1493867cbfb2.jpg not downloaded yet
2026-03-27 12:10:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 12:10:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:10:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7cfe095d50>
2026-03-27 12:10:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:10:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:10:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:10:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1466d57b-48fb-5f7c-bf02-89823f4e64b8/1466d57b-48fb-5f7c-bf02-89823f4e64b8_image_7.jpg HTTP/1.1" 201 0
2026-03-27 12:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf4%252Fcd%252Ff4cd5bd4fd7f87eb72d921bd7846eee6%252Fpa%252FAB34968_5db592d1c004482386d7e883e392da30.jpg') HTTP/1.1" 204 0
2026-03-27 12:10:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/cd/f4cd5bd4fd7f87eb72d921bd7846eee6/pa/AB34968_5db592d1c004482386d7e883e392da30.jpg saved to cache
2026-03-27 12:10:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 1466d57b-48fb-5f7c-bf02-89823f4e64b8
2026-03-27 12:10:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd3/a1/d3a17b82ad0d3822b1794a1aeec067b2/pa/HP44065_279dd40f06f3aaa45e23ba2e561b1e0e.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:10:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7b/9f/7b9f80bc8f345fe1b730f518c0d28032/pa/LH77043_3b06c00db4ab111cc59cdf2c10308c57.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252F9f%252F7b9f80bc8f345fe1b730f518c0d28032%252Fpa%252FLH77043_6d14bf024770981a98add6f7f42b3772.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:10:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/9f/7b9f80bc8f345fe1b730f518c0d28032/pa/LH77043_6d14bf024770981a98add6f7f42b3772.jpg not downloaded yet
2026-03-27 12:10:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HS59030> (referer: https://www.auto1.com/v1/car-details-view/HS59030/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 12:10:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 12:10:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:10:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7cfcdc8790>
2026-03-27 12:10:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:10:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:10:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:10:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8f3583f6-dcea-5498-a04b-38b00a571276/8f3583f6-dcea-5498-a04b-38b00a571276_image_2.jpg HTTP/1.1" 201 0
2026-03-27 12:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252F9f%252F7b9f80bc8f345fe1b730f518c0d28032%252Fpa%252FLH77043_86be180875496c00361e0601a1ae771b.jpg') HTTP/1.1" 204 0
2026-03-27 12:10:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/9f/7b9f80bc8f345fe1b730f518c0d28032/pa/LH77043_86be180875496c00361e0601a1ae771b.jpg saved to cache
2026-03-27 12:10:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 8f3583f6-dcea-5498-a04b-38b00a571276
2026-03-27 12:10:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf4/cd/f4cd5bd4fd7f87eb72d921bd7846eee6/pa/AB34968_29db6b243f100d626208c7f785785ab3.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:10:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf4/cd/f4cd5bd4fd7f87eb72d921bd7846eee6/pa/AB34968_53f80ba0422e25d635340307ac1d7b65.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:10:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7b/9f/7b9f80bc8f345fe1b730f518c0d28032/pa/LH77043_350a7a84a7cd1bf9aec4b43f8f748c0d.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:10:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcf/78/cf78ad1dea6fc4cefaf484d694378666/pa/VB96147_1b7ef855b9e5a65ae2db95de96f86f8d.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:10:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:10:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7cfdf0c6d0>
2026-03-27 12:10:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:10:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:10:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:10:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1466d57b-48fb-5f7c-bf02-89823f4e64b8/1466d57b-48fb-5f7c-bf02-89823f4e64b8_image_9.jpg HTTP/1.1" 201 0
2026-03-27 12:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf4%252Fcd%252Ff4cd5bd4fd7f87eb72d921bd7846eee6%252Fpa%252FAB34968_e54430657cea3ffdbf6e8e6b61f6cb25.jpg') HTTP/1.1" 204 0
2026-03-27 12:10:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/cd/f4cd5bd4fd7f87eb72d921bd7846eee6/pa/AB34968_e54430657cea3ffdbf6e8e6b61f6cb25.jpg saved to cache
2026-03-27 12:10:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 1466d57b-48fb-5f7c-bf02-89823f4e64b8
2026-03-27 12:10:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 41cbe5b7-07ae-5371-b437-fdcd213bcadc with identifier: AV01442
2026-03-27 12:10:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 41cbe5b7-07ae-5371-b437-fdcd213bcadc with scrape type 1
2026-03-27 12:10:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 8 photos for item 41cbe5b7-07ae-5371-b437-fdcd213bcadc
2026-03-27 12:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252F3e%252F1a3e13f9d5ccdbceb93196f7b275f577%252Fpa%252FAV01442_3389cf0fa80982cd188dad9f47c40647.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:10:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/3e/1a3e13f9d5ccdbceb93196f7b275f577/pa/AV01442_3389cf0fa80982cd188dad9f47c40647.jpg not downloaded yet
2026-03-27 12:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252F3e%252F1a3e13f9d5ccdbceb93196f7b275f577%252Fpa%252FAV01442_6581f5a90148b1d69b18ae36aac3a5f6.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:10:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/3e/1a3e13f9d5ccdbceb93196f7b275f577/pa/AV01442_6581f5a90148b1d69b18ae36aac3a5f6.jpg not downloaded yet
2026-03-27 12:10:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcf/78/cf78ad1dea6fc4cefaf484d694378666/pa/VB96147_732509f992dbd8604d48d956b674d3b0.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:10:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7b/9f/7b9f80bc8f345fe1b730f518c0d28032/pa/LH77043_9b39fe55e4538c566f7c1493867cbfb2.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252F3e%252F1a3e13f9d5ccdbceb93196f7b275f577%252Fpa%252FAV01442_17e98b0a32b5e048848a38a967116489.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:10:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/3e/1a3e13f9d5ccdbceb93196f7b275f577/pa/AV01442_17e98b0a32b5e048848a38a967116489.jpg not downloaded yet
2026-03-27 12:10:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:10:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7cfdfea4d0>
2026-03-27 12:10:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:10:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:10:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:10:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fd45af35-8b23-52ea-8cab-b7a8f4c6671d/fd45af35-8b23-52ea-8cab-b7a8f4c6671d_image_4.jpg HTTP/1.1" 201 0
2026-03-27 12:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd3%252Fa1%252Fd3a17b82ad0d3822b1794a1aeec067b2%252Fpa%252FHP44065_279dd40f06f3aaa45e23ba2e561b1e0e.jpg') HTTP/1.1" 204 0
2026-03-27 12:10:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/a1/d3a17b82ad0d3822b1794a1aeec067b2/pa/HP44065_279dd40f06f3aaa45e23ba2e561b1e0e.jpg saved to cache
2026-03-27 12:10:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item fd45af35-8b23-52ea-8cab-b7a8f4c6671d
2026-03-27 12:10:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:10:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7cfe002b50>
2026-03-27 12:10:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:10:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:10:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:10:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8f3583f6-dcea-5498-a04b-38b00a571276/8f3583f6-dcea-5498-a04b-38b00a571276_image_4.jpg HTTP/1.1" 201 0
2026-03-27 12:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252F9f%252F7b9f80bc8f345fe1b730f518c0d28032%252Fpa%252FLH77043_3b06c00db4ab111cc59cdf2c10308c57.jpg') HTTP/1.1" 204 0
2026-03-27 12:10:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/9f/7b9f80bc8f345fe1b730f518c0d28032/pa/LH77043_3b06c00db4ab111cc59cdf2c10308c57.jpg saved to cache
2026-03-27 12:10:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 8f3583f6-dcea-5498-a04b-38b00a571276
2026-03-27 12:10:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4bb43248-629f-55e6-a122-9c46dc967f13 with identifier: HS59030
2026-03-27 12:10:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4bb43248-629f-55e6-a122-9c46dc967f13 with scrape type 1
2026-03-27 12:10:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 7 photos for item 4bb43248-629f-55e6-a122-9c46dc967f13
2026-03-27 12:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg34%252F79%252F3479fe47e797c33525aacb110e016456%252Fpa%252FHS59030_fbf5ba139ad2789d3f11113c2d3bf1c3.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:10:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img34/79/3479fe47e797c33525aacb110e016456/pa/HS59030_fbf5ba139ad2789d3f11113c2d3bf1c3.jpg not downloaded yet
2026-03-27 12:10:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7b/9f/7b9f80bc8f345fe1b730f518c0d28032/pa/LH77043_d50d1e6f42ddc146dfc3c9273d7200fa.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:10:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7b/9f/7b9f80bc8f345fe1b730f518c0d28032/pa/LH77043_a6cea7e13ce62ee0664c526cbde54211.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252F3e%252F1a3e13f9d5ccdbceb93196f7b275f577%252Fpa%252FAV01442_6bd08f5bbf93f93970bc84eb127f31a7.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:10:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/3e/1a3e13f9d5ccdbceb93196f7b275f577/pa/AV01442_6bd08f5bbf93f93970bc84eb127f31a7.jpg not downloaded yet
2026-03-27 12:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg34%252F79%252F3479fe47e797c33525aacb110e016456%252Fpa%252FHS59030_56c1e3d79dd336b81e42090a0038408b.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:10:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img34/79/3479fe47e797c33525aacb110e016456/pa/HS59030_56c1e3d79dd336b81e42090a0038408b.jpg not downloaded yet
2026-03-27 12:10:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:10:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7cfe050250>
2026-03-27 12:10:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:10:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:10:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:10:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1466d57b-48fb-5f7c-bf02-89823f4e64b8/1466d57b-48fb-5f7c-bf02-89823f4e64b8_image_5.jpg HTTP/1.1" 201 0
2026-03-27 12:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf4%252Fcd%252Ff4cd5bd4fd7f87eb72d921bd7846eee6%252Fpa%252FAB34968_29db6b243f100d626208c7f785785ab3.jpg') HTTP/1.1" 204 0
2026-03-27 12:10:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/cd/f4cd5bd4fd7f87eb72d921bd7846eee6/pa/AB34968_29db6b243f100d626208c7f785785ab3.jpg saved to cache
2026-03-27 12:10:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 1466d57b-48fb-5f7c-bf02-89823f4e64b8
2026-03-27 12:10:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:10:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7cfe226b90>
2026-03-27 12:10:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:10:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:10:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:10:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1466d57b-48fb-5f7c-bf02-89823f4e64b8/1466d57b-48fb-5f7c-bf02-89823f4e64b8_image_4.jpg HTTP/1.1" 201 0
2026-03-27 12:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf4%252Fcd%252Ff4cd5bd4fd7f87eb72d921bd7846eee6%252Fpa%252FAB34968_53f80ba0422e25d635340307ac1d7b65.jpg') HTTP/1.1" 204 0
2026-03-27 12:10:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/cd/f4cd5bd4fd7f87eb72d921bd7846eee6/pa/AB34968_53f80ba0422e25d635340307ac1d7b65.jpg saved to cache
2026-03-27 12:10:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 1466d57b-48fb-5f7c-bf02-89823f4e64b8
2026-03-27 12:10:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:10:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7cfe0ab410>
2026-03-27 12:10:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:10:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:10:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:10:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8f3583f6-dcea-5498-a04b-38b00a571276/8f3583f6-dcea-5498-a04b-38b00a571276_image_5.jpg HTTP/1.1" 201 0
2026-03-27 12:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252F9f%252F7b9f80bc8f345fe1b730f518c0d28032%252Fpa%252FLH77043_350a7a84a7cd1bf9aec4b43f8f748c0d.jpg') HTTP/1.1" 204 0
2026-03-27 12:10:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/9f/7b9f80bc8f345fe1b730f518c0d28032/pa/LH77043_350a7a84a7cd1bf9aec4b43f8f748c0d.jpg saved to cache
2026-03-27 12:10:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 8f3583f6-dcea-5498-a04b-38b00a571276
2026-03-27 12:10:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:10:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7cfdfabd10>
2026-03-27 12:10:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:10:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:10:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:10:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_155d186a-c2a1-57fd-8f5b-08aefda5e6e2/155d186a-c2a1-57fd-8f5b-08aefda5e6e2_image_4.jpg HTTP/1.1" 201 0
2026-03-27 12:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252F78%252Fcf78ad1dea6fc4cefaf484d694378666%252Fpa%252FVB96147_1b7ef855b9e5a65ae2db95de96f86f8d.jpg') HTTP/1.1" 204 0
2026-03-27 12:10:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/78/cf78ad1dea6fc4cefaf484d694378666/pa/VB96147_1b7ef855b9e5a65ae2db95de96f86f8d.jpg saved to cache
2026-03-27 12:10:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 155d186a-c2a1-57fd-8f5b-08aefda5e6e2
2026-03-27 12:10:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:10:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7cfe0a9c50>
2026-03-27 12:10:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:10:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:10:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:10:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_155d186a-c2a1-57fd-8f5b-08aefda5e6e2/155d186a-c2a1-57fd-8f5b-08aefda5e6e2_image_2.jpg HTTP/1.1" 201 0
2026-03-27 12:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252F78%252Fcf78ad1dea6fc4cefaf484d694378666%252Fpa%252FVB96147_732509f992dbd8604d48d956b674d3b0.jpg') HTTP/1.1" 204 0
2026-03-27 12:10:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/78/cf78ad1dea6fc4cefaf484d694378666/pa/VB96147_732509f992dbd8604d48d956b674d3b0.jpg saved to cache
2026-03-27 12:10:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 155d186a-c2a1-57fd-8f5b-08aefda5e6e2
2026-03-27 12:10:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:10:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7d004c5890>
2026-03-27 12:10:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:10:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:10:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:10:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8f3583f6-dcea-5498-a04b-38b00a571276/8f3583f6-dcea-5498-a04b-38b00a571276_image_6.jpg HTTP/1.1" 201 0
2026-03-27 12:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252F9f%252F7b9f80bc8f345fe1b730f518c0d28032%252Fpa%252FLH77043_9b39fe55e4538c566f7c1493867cbfb2.jpg') HTTP/1.1" 204 0
2026-03-27 12:10:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/9f/7b9f80bc8f345fe1b730f518c0d28032/pa/LH77043_9b39fe55e4538c566f7c1493867cbfb2.jpg saved to cache
2026-03-27 12:10:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 8f3583f6-dcea-5498-a04b-38b00a571276
2026-03-27 12:10:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcf/78/cf78ad1dea6fc4cefaf484d694378666/pa/VB96147_94c7a8cfd3409704cf957a13ce72e881.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252F3e%252F1a3e13f9d5ccdbceb93196f7b275f577%252Fpa%252FAV01442_6b9f67a2dd8b6397684f3cbdaa1287f1.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:10:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/3e/1a3e13f9d5ccdbceb93196f7b275f577/pa/AV01442_6b9f67a2dd8b6397684f3cbdaa1287f1.jpg not downloaded yet
2026-03-27 12:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg34%252F79%252F3479fe47e797c33525aacb110e016456%252Fpa%252FHS59030_e8ca380bce785c34f159e2496d535948.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:10:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img34/79/3479fe47e797c33525aacb110e016456/pa/HS59030_e8ca380bce785c34f159e2496d535948.jpg not downloaded yet
2026-03-27 12:10:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7b/9f/7b9f80bc8f345fe1b730f518c0d28032/pa/LH77043_6d14bf024770981a98add6f7f42b3772.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:10:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:10:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7cfcde6990>
2026-03-27 12:10:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:10:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:10:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:10:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8f3583f6-dcea-5498-a04b-38b00a571276/8f3583f6-dcea-5498-a04b-38b00a571276_image_3.jpg HTTP/1.1" 201 0
2026-03-27 12:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252F9f%252F7b9f80bc8f345fe1b730f518c0d28032%252Fpa%252FLH77043_d50d1e6f42ddc146dfc3c9273d7200fa.jpg') HTTP/1.1" 204 0
2026-03-27 12:10:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/9f/7b9f80bc8f345fe1b730f518c0d28032/pa/LH77043_d50d1e6f42ddc146dfc3c9273d7200fa.jpg saved to cache
2026-03-27 12:10:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 8f3583f6-dcea-5498-a04b-38b00a571276
2026-03-27 12:10:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:10:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7cfcde3110>
2026-03-27 12:10:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:10:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:10:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:10:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8f3583f6-dcea-5498-a04b-38b00a571276/8f3583f6-dcea-5498-a04b-38b00a571276_image_1.jpg HTTP/1.1" 201 0
2026-03-27 12:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252F9f%252F7b9f80bc8f345fe1b730f518c0d28032%252Fpa%252FLH77043_a6cea7e13ce62ee0664c526cbde54211.jpg') HTTP/1.1" 204 0
2026-03-27 12:10:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/9f/7b9f80bc8f345fe1b730f518c0d28032/pa/LH77043_a6cea7e13ce62ee0664c526cbde54211.jpg saved to cache
2026-03-27 12:10:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 8f3583f6-dcea-5498-a04b-38b00a571276
2026-03-27 12:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252F3e%252F1a3e13f9d5ccdbceb93196f7b275f577%252Fpa%252FAV01442_ba96187e21c6af8fa373308732b6a4df.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:10:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/3e/1a3e13f9d5ccdbceb93196f7b275f577/pa/AV01442_ba96187e21c6af8fa373308732b6a4df.jpg not downloaded yet
2026-03-27 12:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg34%252F79%252F3479fe47e797c33525aacb110e016456%252Fpa%252FHS59030_46dfb7c4e3328184a94eb2d631b29413.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:10:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img34/79/3479fe47e797c33525aacb110e016456/pa/HS59030_46dfb7c4e3328184a94eb2d631b29413.jpg not downloaded yet
2026-03-27 12:10:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/RC74760> (referer: https://www.auto1.com/v1/car-details-view/RC74760/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 12:10:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GG02103> (referer: https://www.auto1.com/v1/car-details-view/GG02103/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 12:10:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img34/79/3479fe47e797c33525aacb110e016456/pa/HS59030_fbf5ba139ad2789d3f11113c2d3bf1c3.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:10:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 12:10:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 12:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252F3e%252F1a3e13f9d5ccdbceb93196f7b275f577%252Fpa%252FAV01442_f92dc00f9c55d70d1b48849b51efac1f.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:10:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/3e/1a3e13f9d5ccdbceb93196f7b275f577/pa/AV01442_f92dc00f9c55d70d1b48849b51efac1f.jpg not downloaded yet
2026-03-27 12:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg34%252F79%252F3479fe47e797c33525aacb110e016456%252Fpa%252FHS59030_1b60cd450a5d710814ac2bc0d43d75a1.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:10:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img34/79/3479fe47e797c33525aacb110e016456/pa/HS59030_1b60cd450a5d710814ac2bc0d43d75a1.jpg not downloaded yet
2026-03-27 12:10:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:10:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7cfdf34d90>
2026-03-27 12:10:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:10:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:10:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:10:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_155d186a-c2a1-57fd-8f5b-08aefda5e6e2/155d186a-c2a1-57fd-8f5b-08aefda5e6e2_image_3.jpg HTTP/1.1" 201 0
2026-03-27 12:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252F78%252Fcf78ad1dea6fc4cefaf484d694378666%252Fpa%252FVB96147_94c7a8cfd3409704cf957a13ce72e881.jpg') HTTP/1.1" 204 0
2026-03-27 12:10:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/78/cf78ad1dea6fc4cefaf484d694378666/pa/VB96147_94c7a8cfd3409704cf957a13ce72e881.jpg saved to cache
2026-03-27 12:10:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 155d186a-c2a1-57fd-8f5b-08aefda5e6e2
2026-03-27 12:10:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img34/79/3479fe47e797c33525aacb110e016456/pa/HS59030_56c1e3d79dd336b81e42090a0038408b.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:10:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1a/3e/1a3e13f9d5ccdbceb93196f7b275f577/pa/AV01442_17e98b0a32b5e048848a38a967116489.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252F3e%252F1a3e13f9d5ccdbceb93196f7b275f577%252Fpa%252FAV01442_77a6606c0aa94cdaf187769ae80c0203.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:10:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/3e/1a3e13f9d5ccdbceb93196f7b275f577/pa/AV01442_77a6606c0aa94cdaf187769ae80c0203.jpg not downloaded yet
2026-03-27 12:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg34%252F79%252F3479fe47e797c33525aacb110e016456%252Fpa%252FHS59030_ba9edc8db206b5332be1738028a8d0c3.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:10:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img34/79/3479fe47e797c33525aacb110e016456/pa/HS59030_ba9edc8db206b5332be1738028a8d0c3.jpg not downloaded yet
2026-03-27 12:10:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1a/3e/1a3e13f9d5ccdbceb93196f7b275f577/pa/AV01442_3389cf0fa80982cd188dad9f47c40647.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:10:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1a/3e/1a3e13f9d5ccdbceb93196f7b275f577/pa/AV01442_6581f5a90148b1d69b18ae36aac3a5f6.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:10:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:10:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7d0dc80810>
2026-03-27 12:10:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:10:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:10:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:10:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8f3583f6-dcea-5498-a04b-38b00a571276/8f3583f6-dcea-5498-a04b-38b00a571276_image_7.jpg HTTP/1.1" 201 0
2026-03-27 12:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252F9f%252F7b9f80bc8f345fe1b730f518c0d28032%252Fpa%252FLH77043_6d14bf024770981a98add6f7f42b3772.jpg') HTTP/1.1" 204 0
2026-03-27 12:10:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/9f/7b9f80bc8f345fe1b730f518c0d28032/pa/LH77043_6d14bf024770981a98add6f7f42b3772.jpg saved to cache
2026-03-27 12:10:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 8f3583f6-dcea-5498-a04b-38b00a571276
2026-03-27 12:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg34%252F79%252F3479fe47e797c33525aacb110e016456%252Fpa%252FHS59030_df55d3e2e6192f2d92b56d8280db40c2.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:10:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img34/79/3479fe47e797c33525aacb110e016456/pa/HS59030_df55d3e2e6192f2d92b56d8280db40c2.jpg not downloaded yet
2026-03-27 12:10:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img34/79/3479fe47e797c33525aacb110e016456/pa/HS59030_46dfb7c4e3328184a94eb2d631b29413.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:10:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SY53039/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 12:10:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e6075b79-10fa-5ce8-a74f-84de841b9f57 with identifier: RC74760
2026-03-27 12:10:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e6075b79-10fa-5ce8-a74f-84de841b9f57 with scrape type 1
2026-03-27 12:10:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 6 photos for item e6075b79-10fa-5ce8-a74f-84de841b9f57
2026-03-27 12:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252F5a%252F675a145aeb63add0b67e077d1558eca0%252Fpa%252FRC74760_47773d3e0c8bd717c68d988fe3a23e37.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:10:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/5a/675a145aeb63add0b67e077d1558eca0/pa/RC74760_47773d3e0c8bd717c68d988fe3a23e37.jpg not downloaded yet
2026-03-27 12:10:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4e2408e1-db1c-55b2-9b47-89752902d7d2 with identifier: GG02103
2026-03-27 12:10:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4e2408e1-db1c-55b2-9b47-89752902d7d2 with scrape type 1
2026-03-27 12:10:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 4e2408e1-db1c-55b2-9b47-89752902d7d2
2026-03-27 12:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252Fb9%252Fe9b93e6b3cf83c22ce97a0df483ac378%252Fpa%252FGG02103_b83de463cab7b0b60150fa1788483b1d.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:10:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/b9/e9b93e6b3cf83c22ce97a0df483ac378/pa/GG02103_b83de463cab7b0b60150fa1788483b1d.jpg not downloaded yet
2026-03-27 12:10:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:10:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7cfe0b3790>
2026-03-27 12:10:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:10:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:10:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:10:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4bb43248-629f-55e6-a122-9c46dc967f13/4bb43248-629f-55e6-a122-9c46dc967f13_image_0.jpg HTTP/1.1" 201 0
2026-03-27 12:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg34%252F79%252F3479fe47e797c33525aacb110e016456%252Fpa%252FHS59030_fbf5ba139ad2789d3f11113c2d3bf1c3.jpg') HTTP/1.1" 204 0
2026-03-27 12:10:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img34/79/3479fe47e797c33525aacb110e016456/pa/HS59030_fbf5ba139ad2789d3f11113c2d3bf1c3.jpg saved to cache
2026-03-27 12:10:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4bb43248-629f-55e6-a122-9c46dc967f13
2026-03-27 12:10:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1a/3e/1a3e13f9d5ccdbceb93196f7b275f577/pa/AV01442_ba96187e21c6af8fa373308732b6a4df.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:10:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1a/3e/1a3e13f9d5ccdbceb93196f7b275f577/pa/AV01442_6bd08f5bbf93f93970bc84eb127f31a7.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:10:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img34/79/3479fe47e797c33525aacb110e016456/pa/HS59030_1b60cd450a5d710814ac2bc0d43d75a1.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252F5a%252F675a145aeb63add0b67e077d1558eca0%252Fpa%252FRC74760_9bd9b26aad7dbbd63f3841854b5b10e1.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:10:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/5a/675a145aeb63add0b67e077d1558eca0/pa/RC74760_9bd9b26aad7dbbd63f3841854b5b10e1.jpg not downloaded yet
2026-03-27 12:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252Fb9%252Fe9b93e6b3cf83c22ce97a0df483ac378%252Fpa%252FGG02103_3ab3e8fdecee8ce0c95a94f1efd05b8c.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:10:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/b9/e9b93e6b3cf83c22ce97a0df483ac378/pa/GG02103_3ab3e8fdecee8ce0c95a94f1efd05b8c.jpg not downloaded yet
2026-03-27 12:10:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcf/78/cf78ad1dea6fc4cefaf484d694378666/pa/VB96147_49233ccd68fe7eb119d2353765755c53.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:10:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:10:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7cfdee4f50>
2026-03-27 12:10:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:10:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:10:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:10:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4bb43248-629f-55e6-a122-9c46dc967f13/4bb43248-629f-55e6-a122-9c46dc967f13_image_1.jpg HTTP/1.1" 201 0
2026-03-27 12:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg34%252F79%252F3479fe47e797c33525aacb110e016456%252Fpa%252FHS59030_56c1e3d79dd336b81e42090a0038408b.jpg') HTTP/1.1" 204 0
2026-03-27 12:10:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img34/79/3479fe47e797c33525aacb110e016456/pa/HS59030_56c1e3d79dd336b81e42090a0038408b.jpg saved to cache
2026-03-27 12:10:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 4bb43248-629f-55e6-a122-9c46dc967f13
2026-03-27 12:10:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:10:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7cfe044e90>
2026-03-27 12:10:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:10:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:10:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:10:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_41cbe5b7-07ae-5371-b437-fdcd213bcadc/41cbe5b7-07ae-5371-b437-fdcd213bcadc_image_2.jpg HTTP/1.1" 201 0
2026-03-27 12:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252F3e%252F1a3e13f9d5ccdbceb93196f7b275f577%252Fpa%252FAV01442_17e98b0a32b5e048848a38a967116489.jpg') HTTP/1.1" 204 0
2026-03-27 12:10:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/3e/1a3e13f9d5ccdbceb93196f7b275f577/pa/AV01442_17e98b0a32b5e048848a38a967116489.jpg saved to cache
2026-03-27 12:10:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 41cbe5b7-07ae-5371-b437-fdcd213bcadc
2026-03-27 12:10:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 12:10:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:10:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7cfe0bfd10>
2026-03-27 12:10:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:10:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:10:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:10:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_41cbe5b7-07ae-5371-b437-fdcd213bcadc/41cbe5b7-07ae-5371-b437-fdcd213bcadc_image_0.jpg HTTP/1.1" 201 0
2026-03-27 12:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252F3e%252F1a3e13f9d5ccdbceb93196f7b275f577%252Fpa%252FAV01442_3389cf0fa80982cd188dad9f47c40647.jpg') HTTP/1.1" 204 0
2026-03-27 12:10:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/3e/1a3e13f9d5ccdbceb93196f7b275f577/pa/AV01442_3389cf0fa80982cd188dad9f47c40647.jpg saved to cache
2026-03-27 12:10:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 41cbe5b7-07ae-5371-b437-fdcd213bcadc
2026-03-27 12:10:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:10:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7cfce00dd0>
2026-03-27 12:10:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:10:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:10:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:10:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_41cbe5b7-07ae-5371-b437-fdcd213bcadc/41cbe5b7-07ae-5371-b437-fdcd213bcadc_image_1.jpg HTTP/1.1" 201 0
2026-03-27 12:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252F3e%252F1a3e13f9d5ccdbceb93196f7b275f577%252Fpa%252FAV01442_6581f5a90148b1d69b18ae36aac3a5f6.jpg') HTTP/1.1" 204 0
2026-03-27 12:10:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/3e/1a3e13f9d5ccdbceb93196f7b275f577/pa/AV01442_6581f5a90148b1d69b18ae36aac3a5f6.jpg saved to cache
2026-03-27 12:10:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 41cbe5b7-07ae-5371-b437-fdcd213bcadc
2026-03-27 12:10:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1a/3e/1a3e13f9d5ccdbceb93196f7b275f577/pa/AV01442_6b9f67a2dd8b6397684f3cbdaa1287f1.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252F5a%252F675a145aeb63add0b67e077d1558eca0%252Fpa%252FRC74760_491788e4667e05721577a2ee46f3a199.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:10:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/5a/675a145aeb63add0b67e077d1558eca0/pa/RC74760_491788e4667e05721577a2ee46f3a199.jpg not downloaded yet
2026-03-27 12:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252Fb9%252Fe9b93e6b3cf83c22ce97a0df483ac378%252Fpa%252FGG02103_3e56984b408ed0ba765738fec3b9db39.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:10:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/b9/e9b93e6b3cf83c22ce97a0df483ac378/pa/GG02103_3e56984b408ed0ba765738fec3b9db39.jpg not downloaded yet
2026-03-27 12:10:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img34/79/3479fe47e797c33525aacb110e016456/pa/HS59030_ba9edc8db206b5332be1738028a8d0c3.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:10:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img34/79/3479fe47e797c33525aacb110e016456/pa/HS59030_df55d3e2e6192f2d92b56d8280db40c2.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:10:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1a/3e/1a3e13f9d5ccdbceb93196f7b275f577/pa/AV01442_f92dc00f9c55d70d1b48849b51efac1f.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:10:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/JD39017> (referer: https://www.auto1.com/v1/car-details-view/JD39017/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 12:10:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:10:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7cfdefb690>
2026-03-27 12:10:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:10:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:10:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:10:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4bb43248-629f-55e6-a122-9c46dc967f13/4bb43248-629f-55e6-a122-9c46dc967f13_image_3.jpg HTTP/1.1" 201 0
2026-03-27 12:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg34%252F79%252F3479fe47e797c33525aacb110e016456%252Fpa%252FHS59030_46dfb7c4e3328184a94eb2d631b29413.jpg') HTTP/1.1" 204 0
2026-03-27 12:10:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img34/79/3479fe47e797c33525aacb110e016456/pa/HS59030_46dfb7c4e3328184a94eb2d631b29413.jpg saved to cache
2026-03-27 12:10:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 4bb43248-629f-55e6-a122-9c46dc967f13
2026-03-27 12:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252F5a%252F675a145aeb63add0b67e077d1558eca0%252Fpa%252FRC74760_e7c83b90b761e83c14d42ddcec774e72.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:10:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/5a/675a145aeb63add0b67e077d1558eca0/pa/RC74760_e7c83b90b761e83c14d42ddcec774e72.jpg not downloaded yet
2026-03-27 12:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252Fb9%252Fe9b93e6b3cf83c22ce97a0df483ac378%252Fpa%252FGG02103_d5f33cf3240b42efd636bdb93c4b4d7d.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:10:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/b9/e9b93e6b3cf83c22ce97a0df483ac378/pa/GG02103_d5f33cf3240b42efd636bdb93c4b4d7d.jpg not downloaded yet
2026-03-27 12:10:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BU15419/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 12:10:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:10:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7cfdef0590>
2026-03-27 12:10:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:10:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:10:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:10:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_41cbe5b7-07ae-5371-b437-fdcd213bcadc/41cbe5b7-07ae-5371-b437-fdcd213bcadc_image_5.jpg HTTP/1.1" 201 0
2026-03-27 12:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252F3e%252F1a3e13f9d5ccdbceb93196f7b275f577%252Fpa%252FAV01442_ba96187e21c6af8fa373308732b6a4df.jpg') HTTP/1.1" 204 0
2026-03-27 12:10:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/3e/1a3e13f9d5ccdbceb93196f7b275f577/pa/AV01442_ba96187e21c6af8fa373308732b6a4df.jpg saved to cache
2026-03-27 12:10:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 41cbe5b7-07ae-5371-b437-fdcd213bcadc
2026-03-27 12:10:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:10:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7cfce63250>
2026-03-27 12:10:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:10:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:10:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:10:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_41cbe5b7-07ae-5371-b437-fdcd213bcadc/41cbe5b7-07ae-5371-b437-fdcd213bcadc_image_3.jpg HTTP/1.1" 201 0
2026-03-27 12:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252F3e%252F1a3e13f9d5ccdbceb93196f7b275f577%252Fpa%252FAV01442_6bd08f5bbf93f93970bc84eb127f31a7.jpg') HTTP/1.1" 204 0
2026-03-27 12:10:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/3e/1a3e13f9d5ccdbceb93196f7b275f577/pa/AV01442_6bd08f5bbf93f93970bc84eb127f31a7.jpg saved to cache
2026-03-27 12:10:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 41cbe5b7-07ae-5371-b437-fdcd213bcadc
2026-03-27 12:10:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:10:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7cfce78610>
2026-03-27 12:10:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:10:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:10:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:10:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4bb43248-629f-55e6-a122-9c46dc967f13/4bb43248-629f-55e6-a122-9c46dc967f13_image_4.jpg HTTP/1.1" 201 0
2026-03-27 12:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg34%252F79%252F3479fe47e797c33525aacb110e016456%252Fpa%252FHS59030_1b60cd450a5d710814ac2bc0d43d75a1.jpg') HTTP/1.1" 204 0
2026-03-27 12:10:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img34/79/3479fe47e797c33525aacb110e016456/pa/HS59030_1b60cd450a5d710814ac2bc0d43d75a1.jpg saved to cache
2026-03-27 12:10:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 4bb43248-629f-55e6-a122-9c46dc967f13
2026-03-27 12:10:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:10:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7cfce78b90>
2026-03-27 12:10:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:10:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:10:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:10:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_155d186a-c2a1-57fd-8f5b-08aefda5e6e2/155d186a-c2a1-57fd-8f5b-08aefda5e6e2_image_1.jpg HTTP/1.1" 201 0
2026-03-27 12:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252F78%252Fcf78ad1dea6fc4cefaf484d694378666%252Fpa%252FVB96147_49233ccd68fe7eb119d2353765755c53.jpg') HTTP/1.1" 204 0
2026-03-27 12:10:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/78/cf78ad1dea6fc4cefaf484d694378666/pa/VB96147_49233ccd68fe7eb119d2353765755c53.jpg saved to cache
2026-03-27 12:10:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 155d186a-c2a1-57fd-8f5b-08aefda5e6e2
2026-03-27 12:10:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge9/b9/e9b93e6b3cf83c22ce97a0df483ac378/pa/GG02103_b83de463cab7b0b60150fa1788483b1d.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:10:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img34/79/3479fe47e797c33525aacb110e016456/pa/HS59030_e8ca380bce785c34f159e2496d535948.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:10:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1a/3e/1a3e13f9d5ccdbceb93196f7b275f577/pa/AV01442_77a6606c0aa94cdaf187769ae80c0203.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:10:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img67/5a/675a145aeb63add0b67e077d1558eca0/pa/RC74760_47773d3e0c8bd717c68d988fe3a23e37.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252F5a%252F675a145aeb63add0b67e077d1558eca0%252Fpa%252FRC74760_f0eb5e0988d3378044e27006c8b3af8d.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:10:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/5a/675a145aeb63add0b67e077d1558eca0/pa/RC74760_f0eb5e0988d3378044e27006c8b3af8d.jpg not downloaded yet
2026-03-27 12:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252Fb9%252Fe9b93e6b3cf83c22ce97a0df483ac378%252Fpa%252FGG02103_33222e9ed3d283266dd1af5eb6770be4.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:10:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/b9/e9b93e6b3cf83c22ce97a0df483ac378/pa/GG02103_33222e9ed3d283266dd1af5eb6770be4.jpg not downloaded yet
2026-03-27 12:10:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 12:10:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge9/b9/e9b93e6b3cf83c22ce97a0df483ac378/pa/GG02103_3ab3e8fdecee8ce0c95a94f1efd05b8c.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:10:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 12:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252F5a%252F675a145aeb63add0b67e077d1558eca0%252Fpa%252FRC74760_a96f1eeb0d76ef9f7885f3c731bb3f9d.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:10:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/5a/675a145aeb63add0b67e077d1558eca0/pa/RC74760_a96f1eeb0d76ef9f7885f3c731bb3f9d.jpg not downloaded yet
2026-03-27 12:10:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:10:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7cfdfe4790>
2026-03-27 12:10:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:10:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:10:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:10:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_41cbe5b7-07ae-5371-b437-fdcd213bcadc/41cbe5b7-07ae-5371-b437-fdcd213bcadc_image_4.jpg HTTP/1.1" 201 0
2026-03-27 12:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252F3e%252F1a3e13f9d5ccdbceb93196f7b275f577%252Fpa%252FAV01442_6b9f67a2dd8b6397684f3cbdaa1287f1.jpg') HTTP/1.1" 204 0
2026-03-27 12:10:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/3e/1a3e13f9d5ccdbceb93196f7b275f577/pa/AV01442_6b9f67a2dd8b6397684f3cbdaa1287f1.jpg saved to cache
2026-03-27 12:10:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 41cbe5b7-07ae-5371-b437-fdcd213bcadc
2026-03-27 12:10:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:10:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7cfe21cfd0>
2026-03-27 12:10:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:10:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:10:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:10:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4bb43248-629f-55e6-a122-9c46dc967f13/4bb43248-629f-55e6-a122-9c46dc967f13_image_5.jpg HTTP/1.1" 201 0
2026-03-27 12:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg34%252F79%252F3479fe47e797c33525aacb110e016456%252Fpa%252FHS59030_ba9edc8db206b5332be1738028a8d0c3.jpg') HTTP/1.1" 204 0
2026-03-27 12:10:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img34/79/3479fe47e797c33525aacb110e016456/pa/HS59030_ba9edc8db206b5332be1738028a8d0c3.jpg saved to cache
2026-03-27 12:10:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 4bb43248-629f-55e6-a122-9c46dc967f13
2026-03-27 12:10:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:10:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7cfe0aa3d0>
2026-03-27 12:10:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:10:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:10:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:10:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4bb43248-629f-55e6-a122-9c46dc967f13/4bb43248-629f-55e6-a122-9c46dc967f13_image_6.jpg HTTP/1.1" 201 0
2026-03-27 12:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg34%252F79%252F3479fe47e797c33525aacb110e016456%252Fpa%252FHS59030_df55d3e2e6192f2d92b56d8280db40c2.jpg') HTTP/1.1" 204 0
2026-03-27 12:10:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img34/79/3479fe47e797c33525aacb110e016456/pa/HS59030_df55d3e2e6192f2d92b56d8280db40c2.jpg saved to cache
2026-03-27 12:10:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 4bb43248-629f-55e6-a122-9c46dc967f13
2026-03-27 12:10:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:10:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7cfce43850>
2026-03-27 12:10:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:10:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:10:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:10:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_41cbe5b7-07ae-5371-b437-fdcd213bcadc/41cbe5b7-07ae-5371-b437-fdcd213bcadc_image_6.jpg HTTP/1.1" 201 0
2026-03-27 12:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252F3e%252F1a3e13f9d5ccdbceb93196f7b275f577%252Fpa%252FAV01442_f92dc00f9c55d70d1b48849b51efac1f.jpg') HTTP/1.1" 204 0
2026-03-27 12:10:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/3e/1a3e13f9d5ccdbceb93196f7b275f577/pa/AV01442_f92dc00f9c55d70d1b48849b51efac1f.jpg saved to cache
2026-03-27 12:10:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 41cbe5b7-07ae-5371-b437-fdcd213bcadc
2026-03-27 12:10:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c46c1323-b991-57d9-81ae-bd78bb9d4c4e with identifier: JD39017
2026-03-27 12:10:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c46c1323-b991-57d9-81ae-bd78bb9d4c4e with scrape type 1
2026-03-27 12:10:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c46c1323-b991-57d9-81ae-bd78bb9d4c4e
2026-03-27 12:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg78%252Fac%252F78acb5626ad2a880cfc7b5d9a1a3ecc2%252Fpa%252FJD39017_ec71bcd2337f6b57b7dc911ba0a0edae.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:10:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/ac/78acb5626ad2a880cfc7b5d9a1a3ecc2/pa/JD39017_ec71bcd2337f6b57b7dc911ba0a0edae.jpg not downloaded yet
2026-03-27 12:10:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img67/5a/675a145aeb63add0b67e077d1558eca0/pa/RC74760_9bd9b26aad7dbbd63f3841854b5b10e1.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:10:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcf/78/cf78ad1dea6fc4cefaf484d694378666/pa/VB96147_218ccf08ed0ce88ba5b1fe209026ae96.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:10:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7b/9f/7b9f80bc8f345fe1b730f518c0d28032/pa/LH77043_5b61683bebccb8bb26d84f7ba25d7b61.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:10:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge9/b9/e9b93e6b3cf83c22ce97a0df483ac378/pa/GG02103_3e56984b408ed0ba765738fec3b9db39.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg78%252Fac%252F78acb5626ad2a880cfc7b5d9a1a3ecc2%252Fpa%252FJD39017_7541e436ca54549a8f15ab4e02907d5d.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:10:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/ac/78acb5626ad2a880cfc7b5d9a1a3ecc2/pa/JD39017_7541e436ca54549a8f15ab4e02907d5d.jpg not downloaded yet
2026-03-27 12:10:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf4/cd/f4cd5bd4fd7f87eb72d921bd7846eee6/pa/AB34968_5f42967f039868ad185256127b068fb9.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:10:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img67/5a/675a145aeb63add0b67e077d1558eca0/pa/RC74760_491788e4667e05721577a2ee46f3a199.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:10:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img67/5a/675a145aeb63add0b67e077d1558eca0/pa/RC74760_e7c83b90b761e83c14d42ddcec774e72.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:10:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge9/b9/e9b93e6b3cf83c22ce97a0df483ac378/pa/GG02103_d5f33cf3240b42efd636bdb93c4b4d7d.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg78%252Fac%252F78acb5626ad2a880cfc7b5d9a1a3ecc2%252Fpa%252FJD39017_b55fcb7567355e34df49a28cc8872bd3.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:10:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/ac/78acb5626ad2a880cfc7b5d9a1a3ecc2/pa/JD39017_b55fcb7567355e34df49a28cc8872bd3.jpg not downloaded yet
2026-03-27 12:10:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:10:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7cfce6aad0>
2026-03-27 12:10:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:10:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:10:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:10:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4e2408e1-db1c-55b2-9b47-89752902d7d2/4e2408e1-db1c-55b2-9b47-89752902d7d2_image_0.jpg HTTP/1.1" 201 0
2026-03-27 12:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252Fb9%252Fe9b93e6b3cf83c22ce97a0df483ac378%252Fpa%252FGG02103_b83de463cab7b0b60150fa1788483b1d.jpg') HTTP/1.1" 204 0
2026-03-27 12:10:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/b9/e9b93e6b3cf83c22ce97a0df483ac378/pa/GG02103_b83de463cab7b0b60150fa1788483b1d.jpg saved to cache
2026-03-27 12:10:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4e2408e1-db1c-55b2-9b47-89752902d7d2
2026-03-27 12:10:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:10:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7cfcda4e50>
2026-03-27 12:10:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:10:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:10:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:10:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4bb43248-629f-55e6-a122-9c46dc967f13/4bb43248-629f-55e6-a122-9c46dc967f13_image_2.jpg HTTP/1.1" 201 0
2026-03-27 12:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg34%252F79%252F3479fe47e797c33525aacb110e016456%252Fpa%252FHS59030_e8ca380bce785c34f159e2496d535948.jpg') HTTP/1.1" 204 0
2026-03-27 12:10:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img34/79/3479fe47e797c33525aacb110e016456/pa/HS59030_e8ca380bce785c34f159e2496d535948.jpg saved to cache
2026-03-27 12:10:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 4bb43248-629f-55e6-a122-9c46dc967f13
2026-03-27 12:10:28 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4bb43248-629f-55e6-a122-9c46dc967f13, skipping ID generation
2026-03-27 12:10:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4bb43248-629f-55e6-a122-9c46dc967f13 with scrape type 1
2026-03-27 12:10:28 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4bb43248-629f-55e6-a122-9c46dc967f13 sending to next pipeline
2026-03-27 12:10:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 4bb43248-629f-55e6-a122-9c46dc967f13, identifier: HS59030
2026-03-27 12:10:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:10:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7cfce62310>
2026-03-27 12:10:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:10:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:10:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:10:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_41cbe5b7-07ae-5371-b437-fdcd213bcadc/41cbe5b7-07ae-5371-b437-fdcd213bcadc_image_7.jpg HTTP/1.1" 201 0
2026-03-27 12:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1a%252F3e%252F1a3e13f9d5ccdbceb93196f7b275f577%252Fpa%252FAV01442_77a6606c0aa94cdaf187769ae80c0203.jpg') HTTP/1.1" 204 0
2026-03-27 12:10:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1a/3e/1a3e13f9d5ccdbceb93196f7b275f577/pa/AV01442_77a6606c0aa94cdaf187769ae80c0203.jpg saved to cache
2026-03-27 12:10:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 41cbe5b7-07ae-5371-b437-fdcd213bcadc
2026-03-27 12:10:28 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 41cbe5b7-07ae-5371-b437-fdcd213bcadc, skipping ID generation
2026-03-27 12:10:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 41cbe5b7-07ae-5371-b437-fdcd213bcadc with scrape type 1
2026-03-27 12:10:28 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 41cbe5b7-07ae-5371-b437-fdcd213bcadc sending to next pipeline
2026-03-27 12:10:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 41cbe5b7-07ae-5371-b437-fdcd213bcadc, identifier: AV01442
2026-03-27 12:10:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:10:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7cfffc3cd0>
2026-03-27 12:10:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:10:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:10:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:10:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e6075b79-10fa-5ce8-a74f-84de841b9f57/e6075b79-10fa-5ce8-a74f-84de841b9f57_image_0.jpg HTTP/1.1" 201 0
2026-03-27 12:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252F5a%252F675a145aeb63add0b67e077d1558eca0%252Fpa%252FRC74760_47773d3e0c8bd717c68d988fe3a23e37.jpg') HTTP/1.1" 204 0
2026-03-27 12:10:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/5a/675a145aeb63add0b67e077d1558eca0/pa/RC74760_47773d3e0c8bd717c68d988fe3a23e37.jpg saved to cache
2026-03-27 12:10:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e6075b79-10fa-5ce8-a74f-84de841b9f57
2026-03-27 12:10:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:10:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7d0082bf10>
2026-03-27 12:10:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:10:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:10:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:10:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4e2408e1-db1c-55b2-9b47-89752902d7d2/4e2408e1-db1c-55b2-9b47-89752902d7d2_image_1.jpg HTTP/1.1" 201 0
2026-03-27 12:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252Fb9%252Fe9b93e6b3cf83c22ce97a0df483ac378%252Fpa%252FGG02103_3ab3e8fdecee8ce0c95a94f1efd05b8c.jpg') HTTP/1.1" 204 0
2026-03-27 12:10:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/b9/e9b93e6b3cf83c22ce97a0df483ac378/pa/GG02103_3ab3e8fdecee8ce0c95a94f1efd05b8c.jpg saved to cache
2026-03-27 12:10:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 4e2408e1-db1c-55b2-9b47-89752902d7d2
2026-03-27 12:10:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 4bb43248-629f-55e6-a122-9c46dc967f13 with identifier: HS59030
2026-03-27 12:10:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 4bb43248-629f-55e6-a122-9c46dc967f13 with identifier: HS59030
2026-03-27 12:10:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 4bb43248-629f-55e6-a122-9c46dc967f13 with identifier: HS59030 to the API
2026-03-27 12:10:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 12:10:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 12:10:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img34/79/3479fe47e797c33525aacb110e016456/pa/HS59030_e8ca380bce785c34f159e2496d535948.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 6',
 'engine': '',
 'engine_horse_power': 325,
 'expiration_date': '2026-03-28T16:08:43Z',
 'fuel_type': 'electro',
 'id': '4bb43248-629f-55e6-a122-9c46dc967f13',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HS59030',
 'listing': 'auction',
 'location': 'NL',
 'make': 'Tesla',
 'model': 'Model 3',
 'odometer': 143250,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 7,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4bb43248-629f-55e6-a122-9c46dc967f13/4bb43248-629f-55e6-a122-9c46dc967f13_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61005,
             'Height': 450,
             'OriginUrl': 'https://img-pa.auto1.com/img34/79/3479fe47e797c33525aacb110e016456/pa/HS59030_fbf5ba139ad2789d3f11113c2d3bf1c3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4bb43248-629f-55e6-a122-9c46dc967f13/4bb43248-629f-55e6-a122-9c46dc967f13_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59464,
             'Height': 450,
             'OriginUrl': 'https://img-pa.auto1.com/img34/79/3479fe47e797c33525aacb110e016456/pa/HS59030_56c1e3d79dd336b81e42090a0038408b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4bb43248-629f-55e6-a122-9c46dc967f13/4bb43248-629f-55e6-a122-9c46dc967f13_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58672,
             'Height': 450,
             'OriginUrl': 'https://img-pa.auto1.com/img34/79/3479fe47e797c33525aacb110e016456/pa/HS59030_e8ca380bce785c34f159e2496d535948.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4bb43248-629f-55e6-a122-9c46dc967f13/4bb43248-629f-55e6-a122-9c46dc967f13_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63326,
             'Height': 450,
             'OriginUrl': 'https://img-pa.auto1.com/img34/79/3479fe47e797c33525aacb110e016456/pa/HS59030_46dfb7c4e3328184a94eb2d631b29413.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4bb43248-629f-55e6-a122-9c46dc967f13/4bb43248-629f-55e6-a122-9c46dc967f13_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 48950,
             'Height': 450,
             'OriginUrl': 'https://img-pa.auto1.com/img34/79/3479fe47e797c33525aacb110e016456/pa/HS59030_1b60cd450a5d710814ac2bc0d43d75a1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4bb43248-629f-55e6-a122-9c46dc967f13/4bb43248-629f-55e6-a122-9c46dc967f13_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 40995,
             'Height': 450,
             'OriginUrl': 'https://img-pa.auto1.com/img34/79/3479fe47e797c33525aacb110e016456/pa/HS59030_ba9edc8db206b5332be1738028a8d0c3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4bb43248-629f-55e6-a122-9c46dc967f13/4bb43248-629f-55e6-a122-9c46dc967f13_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52921,
             'Height': 450,
             'OriginUrl': 'https://img-pa.auto1.com/img34/79/3479fe47e797c33525aacb110e016456/pa/HS59030_df55d3e2e6192f2d92b56d8280db40c2.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2020-03-09',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Tesla Model 3 Standard Range Plus RWD',
 'transmission': 'automatic',
 'trim': '',
 'year': 2020}
2026-03-27 12:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HS59030%27 HTTP/1.1" 200 None
2026-03-27 12:10:29 [auto1.nl] INFO: Saving data for HS59030: {'created_time': 1774613429.392344, 'last_price_update_time': 1774613429.392356, 'auction_closing_time': 1774714123.0}
2026-03-27 12:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='HS59030') HTTP/1.1" 204 0
2026-03-27 12:10:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 41cbe5b7-07ae-5371-b437-fdcd213bcadc with identifier: AV01442
2026-03-27 12:10:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 41cbe5b7-07ae-5371-b437-fdcd213bcadc with identifier: AV01442
2026-03-27 12:10:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 41cbe5b7-07ae-5371-b437-fdcd213bcadc with identifier: AV01442 to the API
2026-03-27 12:10:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 12:10:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 12:10:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img1a/3e/1a3e13f9d5ccdbceb93196f7b275f577/pa/AV01442_77a6606c0aa94cdaf187769ae80c0203.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'engine_horse_power': 190,
 'expiration_date': '2026-03-28T16:36:59Z',
 'fuel_type': 'electro',
 'id': '41cbe5b7-07ae-5371-b437-fdcd213bcadc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AV01442',
 'listing': 'auction',
 'location': 'NL',
 'make': 'Mercedes-Benz',
 'model': 'EQB',
 'odometer': 53482,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 8,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_41cbe5b7-07ae-5371-b437-fdcd213bcadc/41cbe5b7-07ae-5371-b437-fdcd213bcadc_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 478694,
             'Height': 1080,
             'OriginUrl': 'https://img-pa.auto1.com/img1a/3e/1a3e13f9d5ccdbceb93196f7b275f577/pa/AV01442_3389cf0fa80982cd188dad9f47c40647.jpg',
             'Width': 1920},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_41cbe5b7-07ae-5371-b437-fdcd213bcadc/41cbe5b7-07ae-5371-b437-fdcd213bcadc_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 475915,
             'Height': 1080,
             'OriginUrl': 'https://img-pa.auto1.com/img1a/3e/1a3e13f9d5ccdbceb93196f7b275f577/pa/AV01442_6581f5a90148b1d69b18ae36aac3a5f6.jpg',
             'Width': 1920},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_41cbe5b7-07ae-5371-b437-fdcd213bcadc/41cbe5b7-07ae-5371-b437-fdcd213bcadc_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59734,
             'Height': 450,
             'OriginUrl': 'https://img-pa.auto1.com/img1a/3e/1a3e13f9d5ccdbceb93196f7b275f577/pa/AV01442_17e98b0a32b5e048848a38a967116489.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_41cbe5b7-07ae-5371-b437-fdcd213bcadc/41cbe5b7-07ae-5371-b437-fdcd213bcadc_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62600,
             'Height': 450,
             'OriginUrl': 'https://img-pa.auto1.com/img1a/3e/1a3e13f9d5ccdbceb93196f7b275f577/pa/AV01442_6bd08f5bbf93f93970bc84eb127f31a7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_41cbe5b7-07ae-5371-b437-fdcd213bcadc/41cbe5b7-07ae-5371-b437-fdcd213bcadc_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 158500,
             'Height': 1080,
             'OriginUrl': 'https://img-pa.auto1.com/img1a/3e/1a3e13f9d5ccdbceb93196f7b275f577/pa/AV01442_6b9f67a2dd8b6397684f3cbdaa1287f1.jpg',
             'Width': 1920},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_41cbe5b7-07ae-5371-b437-fdcd213bcadc/41cbe5b7-07ae-5371-b437-fdcd213bcadc_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 157310,
             'Height': 1080,
             'OriginUrl': 'https://img-pa.auto1.com/img1a/3e/1a3e13f9d5ccdbceb93196f7b275f577/pa/AV01442_ba96187e21c6af8fa373308732b6a4df.jpg',
             'Width': 1920},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_41cbe5b7-07ae-5371-b437-fdcd213bcadc/41cbe5b7-07ae-5371-b437-fdcd213bcadc_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 41086,
             'Height': 450,
             'OriginUrl': 'https://img-pa.auto1.com/img1a/3e/1a3e13f9d5ccdbceb93196f7b275f577/pa/AV01442_f92dc00f9c55d70d1b48849b51efac1f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_41cbe5b7-07ae-5371-b437-fdcd213bcadc/41cbe5b7-07ae-5371-b437-fdcd213bcadc_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 46481,
             'Height': 450,
             'OriginUrl': 'https://img-pa.auto1.com/img1a/3e/1a3e13f9d5ccdbceb93196f7b275f577/pa/AV01442_77a6606c0aa94cdaf187769ae80c0203.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-09-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz EQB 250 Progressive',
 'transmission': 'automatic',
 'trim': 'Progressive',
 'year': 2022}
2026-03-27 12:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AV01442%27 HTTP/1.1" 200 None
2026-03-27 12:10:29 [auto1.nl] INFO: Saving data for AV01442: {'created_time': 1774613429.99159, 'last_price_update_time': 1774613429.9916, 'auction_closing_time': 1774715819.0}
2026-03-27 12:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='AV01442') HTTP/1.1" 204 0
2026-03-27 12:10:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge9/b9/e9b93e6b3cf83c22ce97a0df483ac378/pa/GG02103_33222e9ed3d283266dd1af5eb6770be4.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg78%252Fac%252F78acb5626ad2a880cfc7b5d9a1a3ecc2%252Fpa%252FJD39017_22adf2c3693daa569d921cc28128cf69.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:10:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/ac/78acb5626ad2a880cfc7b5d9a1a3ecc2/pa/JD39017_22adf2c3693daa569d921cc28128cf69.jpg not downloaded yet
2026-03-27 12:10:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img78/ac/78acb5626ad2a880cfc7b5d9a1a3ecc2/pa/JD39017_ec71bcd2337f6b57b7dc911ba0a0edae.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:10:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img67/5a/675a145aeb63add0b67e077d1558eca0/pa/RC74760_a96f1eeb0d76ef9f7885f3c731bb3f9d.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:10:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PA07201/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 12:10:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/TC15988/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 12:10:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FK39304/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 12:10:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:10:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7cfe226010>
2026-03-27 12:10:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:10:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:10:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:10:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e6075b79-10fa-5ce8-a74f-84de841b9f57/e6075b79-10fa-5ce8-a74f-84de841b9f57_image_1.jpg HTTP/1.1" 201 0
2026-03-27 12:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252F5a%252F675a145aeb63add0b67e077d1558eca0%252Fpa%252FRC74760_9bd9b26aad7dbbd63f3841854b5b10e1.jpg') HTTP/1.1" 204 0
2026-03-27 12:10:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/5a/675a145aeb63add0b67e077d1558eca0/pa/RC74760_9bd9b26aad7dbbd63f3841854b5b10e1.jpg saved to cache
2026-03-27 12:10:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e6075b79-10fa-5ce8-a74f-84de841b9f57
2026-03-27 12:10:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:10:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7cfdef9690>
2026-03-27 12:10:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:10:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:10:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:10:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_155d186a-c2a1-57fd-8f5b-08aefda5e6e2/155d186a-c2a1-57fd-8f5b-08aefda5e6e2_image_0.jpg HTTP/1.1" 201 0
2026-03-27 12:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcf%252F78%252Fcf78ad1dea6fc4cefaf484d694378666%252Fpa%252FVB96147_218ccf08ed0ce88ba5b1fe209026ae96.jpg') HTTP/1.1" 204 0
2026-03-27 12:10:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcf/78/cf78ad1dea6fc4cefaf484d694378666/pa/VB96147_218ccf08ed0ce88ba5b1fe209026ae96.jpg saved to cache
2026-03-27 12:10:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 155d186a-c2a1-57fd-8f5b-08aefda5e6e2
2026-03-27 12:10:30 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 155d186a-c2a1-57fd-8f5b-08aefda5e6e2, skipping ID generation
2026-03-27 12:10:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 155d186a-c2a1-57fd-8f5b-08aefda5e6e2 with scrape type 1
2026-03-27 12:10:30 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 155d186a-c2a1-57fd-8f5b-08aefda5e6e2 sending to next pipeline
2026-03-27 12:10:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 155d186a-c2a1-57fd-8f5b-08aefda5e6e2, identifier: VB96147
2026-03-27 12:10:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:10:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7cfe0bd590>
2026-03-27 12:10:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:10:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:10:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:10:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8f3583f6-dcea-5498-a04b-38b00a571276/8f3583f6-dcea-5498-a04b-38b00a571276_image_0.jpg HTTP/1.1" 201 0
2026-03-27 12:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7b%252F9f%252F7b9f80bc8f345fe1b730f518c0d28032%252Fpa%252FLH77043_5b61683bebccb8bb26d84f7ba25d7b61.jpg') HTTP/1.1" 204 0
2026-03-27 12:10:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7b/9f/7b9f80bc8f345fe1b730f518c0d28032/pa/LH77043_5b61683bebccb8bb26d84f7ba25d7b61.jpg saved to cache
2026-03-27 12:10:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8f3583f6-dcea-5498-a04b-38b00a571276
2026-03-27 12:10:30 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8f3583f6-dcea-5498-a04b-38b00a571276, skipping ID generation
2026-03-27 12:10:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8f3583f6-dcea-5498-a04b-38b00a571276 with scrape type 1
2026-03-27 12:10:30 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8f3583f6-dcea-5498-a04b-38b00a571276 sending to next pipeline
2026-03-27 12:10:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 8f3583f6-dcea-5498-a04b-38b00a571276, identifier: LH77043
2026-03-27 12:10:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:10:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7cfe0a9a10>
2026-03-27 12:10:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:10:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:10:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:10:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4e2408e1-db1c-55b2-9b47-89752902d7d2/4e2408e1-db1c-55b2-9b47-89752902d7d2_image_2.jpg HTTP/1.1" 201 0
2026-03-27 12:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252Fb9%252Fe9b93e6b3cf83c22ce97a0df483ac378%252Fpa%252FGG02103_3e56984b408ed0ba765738fec3b9db39.jpg') HTTP/1.1" 204 0
2026-03-27 12:10:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/b9/e9b93e6b3cf83c22ce97a0df483ac378/pa/GG02103_3e56984b408ed0ba765738fec3b9db39.jpg saved to cache
2026-03-27 12:10:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 4e2408e1-db1c-55b2-9b47-89752902d7d2
2026-03-27 12:10:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:10:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7cfe1f5110>
2026-03-27 12:10:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:10:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:10:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:10:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1466d57b-48fb-5f7c-bf02-89823f4e64b8/1466d57b-48fb-5f7c-bf02-89823f4e64b8_image_8.jpg HTTP/1.1" 201 0
2026-03-27 12:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf4%252Fcd%252Ff4cd5bd4fd7f87eb72d921bd7846eee6%252Fpa%252FAB34968_5f42967f039868ad185256127b068fb9.jpg') HTTP/1.1" 204 0
2026-03-27 12:10:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/cd/f4cd5bd4fd7f87eb72d921bd7846eee6/pa/AB34968_5f42967f039868ad185256127b068fb9.jpg saved to cache
2026-03-27 12:10:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 1466d57b-48fb-5f7c-bf02-89823f4e64b8
2026-03-27 12:10:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:10:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7cfce6cb90>
2026-03-27 12:10:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:10:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:10:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:10:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e6075b79-10fa-5ce8-a74f-84de841b9f57/e6075b79-10fa-5ce8-a74f-84de841b9f57_image_2.jpg HTTP/1.1" 201 0
2026-03-27 12:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252F5a%252F675a145aeb63add0b67e077d1558eca0%252Fpa%252FRC74760_491788e4667e05721577a2ee46f3a199.jpg') HTTP/1.1" 204 0
2026-03-27 12:10:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/5a/675a145aeb63add0b67e077d1558eca0/pa/RC74760_491788e4667e05721577a2ee46f3a199.jpg saved to cache
2026-03-27 12:10:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e6075b79-10fa-5ce8-a74f-84de841b9f57
2026-03-27 12:10:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:10:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7cfdf9bb10>
2026-03-27 12:10:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:10:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:10:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:10:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e6075b79-10fa-5ce8-a74f-84de841b9f57/e6075b79-10fa-5ce8-a74f-84de841b9f57_image_3.jpg HTTP/1.1" 201 0
2026-03-27 12:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252F5a%252F675a145aeb63add0b67e077d1558eca0%252Fpa%252FRC74760_e7c83b90b761e83c14d42ddcec774e72.jpg') HTTP/1.1" 204 0
2026-03-27 12:10:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/5a/675a145aeb63add0b67e077d1558eca0/pa/RC74760_e7c83b90b761e83c14d42ddcec774e72.jpg saved to cache
2026-03-27 12:10:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e6075b79-10fa-5ce8-a74f-84de841b9f57
2026-03-27 12:10:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:10:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7cfe120810>
2026-03-27 12:10:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:10:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:10:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:10:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4e2408e1-db1c-55b2-9b47-89752902d7d2/4e2408e1-db1c-55b2-9b47-89752902d7d2_image_3.jpg HTTP/1.1" 201 0
2026-03-27 12:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252Fb9%252Fe9b93e6b3cf83c22ce97a0df483ac378%252Fpa%252FGG02103_d5f33cf3240b42efd636bdb93c4b4d7d.jpg') HTTP/1.1" 204 0
2026-03-27 12:10:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/b9/e9b93e6b3cf83c22ce97a0df483ac378/pa/GG02103_d5f33cf3240b42efd636bdb93c4b4d7d.jpg saved to cache
2026-03-27 12:10:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 4e2408e1-db1c-55b2-9b47-89752902d7d2
2026-03-27 12:10:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd3/a1/d3a17b82ad0d3822b1794a1aeec067b2/pa/HP44065_31f578763c14aeb611ea866ef0c50221.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:10:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img67/5a/675a145aeb63add0b67e077d1558eca0/pa/RC74760_f0eb5e0988d3378044e27006c8b3af8d.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:10:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf4/cd/f4cd5bd4fd7f87eb72d921bd7846eee6/pa/AB34968_2b59417b32b09f86f010b6ef2bc2e072.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg78%252Fac%252F78acb5626ad2a880cfc7b5d9a1a3ecc2%252Fpa%252FJD39017_8c7d0547dd629c42d290e5803b7bcf9d.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:10:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/ac/78acb5626ad2a880cfc7b5d9a1a3ecc2/pa/JD39017_8c7d0547dd629c42d290e5803b7bcf9d.jpg not downloaded yet
2026-03-27 12:10:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 12:10:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 12:10:30 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 12:10:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FC64695/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 12:10:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 155d186a-c2a1-57fd-8f5b-08aefda5e6e2 with identifier: VB96147
2026-03-27 12:10:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 155d186a-c2a1-57fd-8f5b-08aefda5e6e2 with identifier: VB96147
2026-03-27 12:10:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 155d186a-c2a1-57fd-8f5b-08aefda5e6e2 with identifier: VB96147 to the API
2026-03-27 12:10:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 12:10:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 12:10:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgcf/78/cf78ad1dea6fc4cefaf484d694378666/pa/VB96147_218ccf08ed0ce88ba5b1fe209026ae96.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.6L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:06:48Z',
 'fuel_type': 'petrol',
 'id': '155d186a-c2a1-57fd-8f5b-08aefda5e6e2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': '92PZP7',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VB96147',
 'listing': 'auction',
 'location': 'NL, Den Haag',
 'make': 'Ford',
 'model': 'C-Max',
 'odometer': 200922,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_155d186a-c2a1-57fd-8f5b-08aefda5e6e2/155d186a-c2a1-57fd-8f5b-08aefda5e6e2_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83651,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcf/78/cf78ad1dea6fc4cefaf484d694378666/pa/VB96147_218ccf08ed0ce88ba5b1fe209026ae96.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_155d186a-c2a1-57fd-8f5b-08aefda5e6e2/155d186a-c2a1-57fd-8f5b-08aefda5e6e2_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79267,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcf/78/cf78ad1dea6fc4cefaf484d694378666/pa/VB96147_49233ccd68fe7eb119d2353765755c53.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_155d186a-c2a1-57fd-8f5b-08aefda5e6e2/155d186a-c2a1-57fd-8f5b-08aefda5e6e2_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79603,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcf/78/cf78ad1dea6fc4cefaf484d694378666/pa/VB96147_732509f992dbd8604d48d956b674d3b0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_155d186a-c2a1-57fd-8f5b-08aefda5e6e2/155d186a-c2a1-57fd-8f5b-08aefda5e6e2_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73989,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcf/78/cf78ad1dea6fc4cefaf484d694378666/pa/VB96147_94c7a8cfd3409704cf957a13ce72e881.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_155d186a-c2a1-57fd-8f5b-08aefda5e6e2/155d186a-c2a1-57fd-8f5b-08aefda5e6e2_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 94690,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcf/78/cf78ad1dea6fc4cefaf484d694378666/pa/VB96147_1b7ef855b9e5a65ae2db95de96f86f8d.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2011-05-02',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford C-Max 1.6 EcoBoost Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2011}
2026-03-27 12:10:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VB96147%27 HTTP/1.1" 200 None
2026-03-27 12:10:31 [auto1.nl] INFO: Saving data for VB96147: {'created_time': 1774613431.46133, 'last_price_update_time': 1774613431.461346, 'auction_closing_time': 1774714008.0}
2026-03-27 12:10:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='VB96147') HTTP/1.1" 204 0
2026-03-27 12:10:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 8f3583f6-dcea-5498-a04b-38b00a571276 with identifier: LH77043
2026-03-27 12:10:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 8f3583f6-dcea-5498-a04b-38b00a571276 with identifier: LH77043
2026-03-27 12:10:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 8f3583f6-dcea-5498-a04b-38b00a571276 with identifier: LH77043 to the API
2026-03-27 12:10:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 12:10:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 12:10:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img7b/9f/7b9f80bc8f345fe1b730f518c0d28032/pa/LH77043_5b61683bebccb8bb26d84f7ba25d7b61.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '',
 'engine_horse_power': 145,
 'expiration_date': '2026-03-28T16:13:02Z',
 'fuel_type': 'electro',
 'id': '8f3583f6-dcea-5498-a04b-38b00a571276',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LH77043',
 'listing': 'auction',
 'location': 'NL',
 'make': 'Volkswagen',
 'model': 'ID.3',
 'odometer': 65903,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 8,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8f3583f6-dcea-5498-a04b-38b00a571276/8f3583f6-dcea-5498-a04b-38b00a571276_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62901,
             'Height': 450,
             'OriginUrl': 'https://img-pa.auto1.com/img7b/9f/7b9f80bc8f345fe1b730f518c0d28032/pa/LH77043_5b61683bebccb8bb26d84f7ba25d7b61.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8f3583f6-dcea-5498-a04b-38b00a571276/8f3583f6-dcea-5498-a04b-38b00a571276_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62844,
             'Height': 450,
             'OriginUrl': 'https://img-pa.auto1.com/img7b/9f/7b9f80bc8f345fe1b730f518c0d28032/pa/LH77043_a6cea7e13ce62ee0664c526cbde54211.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8f3583f6-dcea-5498-a04b-38b00a571276/8f3583f6-dcea-5498-a04b-38b00a571276_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62024,
             'Height': 450,
             'OriginUrl': 'https://img-pa.auto1.com/img7b/9f/7b9f80bc8f345fe1b730f518c0d28032/pa/LH77043_86be180875496c00361e0601a1ae771b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8f3583f6-dcea-5498-a04b-38b00a571276/8f3583f6-dcea-5498-a04b-38b00a571276_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64124,
             'Height': 450,
             'OriginUrl': 'https://img-pa.auto1.com/img7b/9f/7b9f80bc8f345fe1b730f518c0d28032/pa/LH77043_d50d1e6f42ddc146dfc3c9273d7200fa.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8f3583f6-dcea-5498-a04b-38b00a571276/8f3583f6-dcea-5498-a04b-38b00a571276_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55467,
             'Height': 450,
             'OriginUrl': 'https://img-pa.auto1.com/img7b/9f/7b9f80bc8f345fe1b730f518c0d28032/pa/LH77043_3b06c00db4ab111cc59cdf2c10308c57.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8f3583f6-dcea-5498-a04b-38b00a571276/8f3583f6-dcea-5498-a04b-38b00a571276_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50240,
             'Height': 450,
             'OriginUrl': 'https://img-pa.auto1.com/img7b/9f/7b9f80bc8f345fe1b730f518c0d28032/pa/LH77043_350a7a84a7cd1bf9aec4b43f8f748c0d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8f3583f6-dcea-5498-a04b-38b00a571276/8f3583f6-dcea-5498-a04b-38b00a571276_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 40406,
             'Height': 450,
             'OriginUrl': 'https://img-pa.auto1.com/img7b/9f/7b9f80bc8f345fe1b730f518c0d28032/pa/LH77043_9b39fe55e4538c566f7c1493867cbfb2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8f3583f6-dcea-5498-a04b-38b00a571276/8f3583f6-dcea-5498-a04b-38b00a571276_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51204,
             'Height': 450,
             'OriginUrl': 'https://img-pa.auto1.com/img7b/9f/7b9f80bc8f345fe1b730f518c0d28032/pa/LH77043_6d14bf024770981a98add6f7f42b3772.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-08-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen ID.3 electric drive 107 kW Pro',
 'transmission': 'automatic',
 'trim': 'Pro',
 'year': 2022}
2026-03-27 12:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LH77043%27 HTTP/1.1" 200 None
2026-03-27 12:10:32 [auto1.nl] INFO: Saving data for LH77043: {'created_time': 1774613432.075512, 'last_price_update_time': 1774613432.075522, 'auction_closing_time': 1774714382.0}
2026-03-27 12:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='LH77043') HTTP/1.1" 204 0
2026-03-27 12:10:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 12:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg78%252Fac%252F78acb5626ad2a880cfc7b5d9a1a3ecc2%252Fpa%252FJD39017_f48398212104d506cafddfc9fcd43dbd.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:10:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/ac/78acb5626ad2a880cfc7b5d9a1a3ecc2/pa/JD39017_f48398212104d506cafddfc9fcd43dbd.jpg not downloaded yet
2026-03-27 12:10:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GP63449/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 12:10:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SY53039> (referer: https://www.auto1.com/v1/car-details-view/SY53039/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 12:10:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:10:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7cfe1f4750>
2026-03-27 12:10:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:10:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:10:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:10:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4e2408e1-db1c-55b2-9b47-89752902d7d2/4e2408e1-db1c-55b2-9b47-89752902d7d2_image_4.jpg HTTP/1.1" 201 0
2026-03-27 12:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge9%252Fb9%252Fe9b93e6b3cf83c22ce97a0df483ac378%252Fpa%252FGG02103_33222e9ed3d283266dd1af5eb6770be4.jpg') HTTP/1.1" 204 0
2026-03-27 12:10:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge9/b9/e9b93e6b3cf83c22ce97a0df483ac378/pa/GG02103_33222e9ed3d283266dd1af5eb6770be4.jpg saved to cache
2026-03-27 12:10:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 4e2408e1-db1c-55b2-9b47-89752902d7d2
2026-03-27 12:10:32 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4e2408e1-db1c-55b2-9b47-89752902d7d2, skipping ID generation
2026-03-27 12:10:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4e2408e1-db1c-55b2-9b47-89752902d7d2 with scrape type 1
2026-03-27 12:10:32 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4e2408e1-db1c-55b2-9b47-89752902d7d2 sending to next pipeline
2026-03-27 12:10:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 4e2408e1-db1c-55b2-9b47-89752902d7d2, identifier: GG02103
2026-03-27 12:10:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:10:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7cfdfc9d50>
2026-03-27 12:10:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:10:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:10:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:10:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c46c1323-b991-57d9-81ae-bd78bb9d4c4e/c46c1323-b991-57d9-81ae-bd78bb9d4c4e_image_0.jpg HTTP/1.1" 201 0
2026-03-27 12:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg78%252Fac%252F78acb5626ad2a880cfc7b5d9a1a3ecc2%252Fpa%252FJD39017_ec71bcd2337f6b57b7dc911ba0a0edae.jpg') HTTP/1.1" 204 0
2026-03-27 12:10:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/ac/78acb5626ad2a880cfc7b5d9a1a3ecc2/pa/JD39017_ec71bcd2337f6b57b7dc911ba0a0edae.jpg saved to cache
2026-03-27 12:10:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c46c1323-b991-57d9-81ae-bd78bb9d4c4e
2026-03-27 12:10:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:10:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7cfcccd650>
2026-03-27 12:10:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:10:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:10:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:10:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e6075b79-10fa-5ce8-a74f-84de841b9f57/e6075b79-10fa-5ce8-a74f-84de841b9f57_image_5.jpg HTTP/1.1" 201 0
2026-03-27 12:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252F5a%252F675a145aeb63add0b67e077d1558eca0%252Fpa%252FRC74760_a96f1eeb0d76ef9f7885f3c731bb3f9d.jpg') HTTP/1.1" 204 0
2026-03-27 12:10:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/5a/675a145aeb63add0b67e077d1558eca0/pa/RC74760_a96f1eeb0d76ef9f7885f3c731bb3f9d.jpg saved to cache
2026-03-27 12:10:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e6075b79-10fa-5ce8-a74f-84de841b9f57
2026-03-27 12:10:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 12:10:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/HA14742> (referer: https://www.auto1.com/v1/car-details-view/HA14742/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 12:10:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 4e2408e1-db1c-55b2-9b47-89752902d7d2 with identifier: GG02103
2026-03-27 12:10:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 4e2408e1-db1c-55b2-9b47-89752902d7d2 with identifier: GG02103
2026-03-27 12:10:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 4e2408e1-db1c-55b2-9b47-89752902d7d2 with identifier: GG02103 to the API
2026-03-27 12:10:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 12:10:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 12:10:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imge9/b9/e9b93e6b3cf83c22ce97a0df483ac378/pa/GG02103_33222e9ed3d283266dd1af5eb6770be4.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 109,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'engine_horse_power': 100,
 'expiration_date': '2026-03-28T16:21:09Z',
 'fuel_type': 'petrol',
 'id': '4e2408e1-db1c-55b2-9b47-89752902d7d2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': '2TDB09',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GG02103',
 'listing': 'auction',
 'location': 'NL, Breukelen',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 181472,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4e2408e1-db1c-55b2-9b47-89752902d7d2/4e2408e1-db1c-55b2-9b47-89752902d7d2_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64118,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge9/b9/e9b93e6b3cf83c22ce97a0df483ac378/pa/GG02103_b83de463cab7b0b60150fa1788483b1d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4e2408e1-db1c-55b2-9b47-89752902d7d2/4e2408e1-db1c-55b2-9b47-89752902d7d2_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74309,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge9/b9/e9b93e6b3cf83c22ce97a0df483ac378/pa/GG02103_3ab3e8fdecee8ce0c95a94f1efd05b8c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4e2408e1-db1c-55b2-9b47-89752902d7d2/4e2408e1-db1c-55b2-9b47-89752902d7d2_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62871,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge9/b9/e9b93e6b3cf83c22ce97a0df483ac378/pa/GG02103_3e56984b408ed0ba765738fec3b9db39.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4e2408e1-db1c-55b2-9b47-89752902d7d2/4e2408e1-db1c-55b2-9b47-89752902d7d2_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70115,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge9/b9/e9b93e6b3cf83c22ce97a0df483ac378/pa/GG02103_d5f33cf3240b42efd636bdb93c4b4d7d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4e2408e1-db1c-55b2-9b47-89752902d7d2/4e2408e1-db1c-55b2-9b47-89752902d7d2_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50485,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge9/b9/e9b93e6b3cf83c22ce97a0df483ac378/pa/GG02103_33222e9ed3d283266dd1af5eb6770be4.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2014-01-06',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford Focus 1.0 EcoBoost Trend',
 'transmission': 'manual',
 'trim': 'Trend',
 'year': 2014}
2026-03-27 12:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GG02103%27 HTTP/1.1" 200 None
2026-03-27 12:10:32 [auto1.nl] INFO: Saving data for GG02103: {'created_time': 1774613432.791702, 'last_price_update_time': 1774613432.791712, 'auction_closing_time': 1774714869.0}
2026-03-27 12:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='GG02103') HTTP/1.1" 204 0
2026-03-27 12:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg78%252Fac%252F78acb5626ad2a880cfc7b5d9a1a3ecc2%252Fpa%252FJD39017_d97d01fdede0d147f5a9b072668d2219.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:10:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/ac/78acb5626ad2a880cfc7b5d9a1a3ecc2/pa/JD39017_d97d01fdede0d147f5a9b072668d2219.jpg not downloaded yet
2026-03-27 12:10:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 12:10:32 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 12:10:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:10:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7cfccb98d0>
2026-03-27 12:10:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:10:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:10:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:10:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fd45af35-8b23-52ea-8cab-b7a8f4c6671d/fd45af35-8b23-52ea-8cab-b7a8f4c6671d_image_3.jpg HTTP/1.1" 201 0
2026-03-27 12:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd3%252Fa1%252Fd3a17b82ad0d3822b1794a1aeec067b2%252Fpa%252FHP44065_31f578763c14aeb611ea866ef0c50221.jpg') HTTP/1.1" 204 0
2026-03-27 12:10:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/a1/d3a17b82ad0d3822b1794a1aeec067b2/pa/HP44065_31f578763c14aeb611ea866ef0c50221.jpg saved to cache
2026-03-27 12:10:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item fd45af35-8b23-52ea-8cab-b7a8f4c6671d
2026-03-27 12:10:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:10:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7cfdfb8a50>
2026-03-27 12:10:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:10:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:10:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:10:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e6075b79-10fa-5ce8-a74f-84de841b9f57/e6075b79-10fa-5ce8-a74f-84de841b9f57_image_4.jpg HTTP/1.1" 201 0
2026-03-27 12:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg67%252F5a%252F675a145aeb63add0b67e077d1558eca0%252Fpa%252FRC74760_f0eb5e0988d3378044e27006c8b3af8d.jpg') HTTP/1.1" 204 0
2026-03-27 12:10:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img67/5a/675a145aeb63add0b67e077d1558eca0/pa/RC74760_f0eb5e0988d3378044e27006c8b3af8d.jpg saved to cache
2026-03-27 12:10:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e6075b79-10fa-5ce8-a74f-84de841b9f57
2026-03-27 12:10:32 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e6075b79-10fa-5ce8-a74f-84de841b9f57, skipping ID generation
2026-03-27 12:10:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e6075b79-10fa-5ce8-a74f-84de841b9f57 with scrape type 1
2026-03-27 12:10:32 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e6075b79-10fa-5ce8-a74f-84de841b9f57 sending to next pipeline
2026-03-27 12:10:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: e6075b79-10fa-5ce8-a74f-84de841b9f57, identifier: RC74760
2026-03-27 12:10:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:10:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7cfccdba10>
2026-03-27 12:10:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:10:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:10:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:10:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1466d57b-48fb-5f7c-bf02-89823f4e64b8/1466d57b-48fb-5f7c-bf02-89823f4e64b8_image_3.jpg HTTP/1.1" 201 0
2026-03-27 12:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf4%252Fcd%252Ff4cd5bd4fd7f87eb72d921bd7846eee6%252Fpa%252FAB34968_2b59417b32b09f86f010b6ef2bc2e072.jpg') HTTP/1.1" 204 0
2026-03-27 12:10:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/cd/f4cd5bd4fd7f87eb72d921bd7846eee6/pa/AB34968_2b59417b32b09f86f010b6ef2bc2e072.jpg saved to cache
2026-03-27 12:10:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 1466d57b-48fb-5f7c-bf02-89823f4e64b8
2026-03-27 12:10:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd3/a1/d3a17b82ad0d3822b1794a1aeec067b2/pa/HP44065_1f420d20de04fa7f560e89c26591bb69.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:10:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd3/a1/d3a17b82ad0d3822b1794a1aeec067b2/pa/HP44065_ce12d5a88fac635a5936360ca230ab0a.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:10:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img78/ac/78acb5626ad2a880cfc7b5d9a1a3ecc2/pa/JD39017_22adf2c3693daa569d921cc28128cf69.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:10:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf4/cd/f4cd5bd4fd7f87eb72d921bd7846eee6/pa/AB34968_6baf6942e39391b10f6c42ccea3752f6.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:10:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img78/ac/78acb5626ad2a880cfc7b5d9a1a3ecc2/pa/JD39017_b55fcb7567355e34df49a28cc8872bd3.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:10:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img78/ac/78acb5626ad2a880cfc7b5d9a1a3ecc2/pa/JD39017_7541e436ca54549a8f15ab4e02907d5d.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:10:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf4/cd/f4cd5bd4fd7f87eb72d921bd7846eee6/pa/AB34968_e709553ca7b6fb3917a87c95fb59ba3c.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:10:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: e6075b79-10fa-5ce8-a74f-84de841b9f57 with identifier: RC74760
2026-03-27 12:10:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: e6075b79-10fa-5ce8-a74f-84de841b9f57 with identifier: RC74760
2026-03-27 12:10:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: e6075b79-10fa-5ce8-a74f-84de841b9f57 with identifier: RC74760 to the API
2026-03-27 12:10:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 12:10:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 12:10:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img67/5a/675a145aeb63add0b67e077d1558eca0/pa/RC74760_f0eb5e0988d3378044e27006c8b3af8d.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 179,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '1.6L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:47:47Z',
 'fuel_type': 'petrol',
 'id': 'e6075b79-10fa-5ce8-a74f-84de841b9f57',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': '22JSB3',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RC74760',
 'listing': 'auction',
 'location': 'NL, Alkmaar',
 'make': 'Peugeot',
 'model': '3008',
 'odometer': 189093,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 6,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e6075b79-10fa-5ce8-a74f-84de841b9f57/e6075b79-10fa-5ce8-a74f-84de841b9f57_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84339,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img67/5a/675a145aeb63add0b67e077d1558eca0/pa/RC74760_47773d3e0c8bd717c68d988fe3a23e37.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e6075b79-10fa-5ce8-a74f-84de841b9f57/e6075b79-10fa-5ce8-a74f-84de841b9f57_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62655,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img67/5a/675a145aeb63add0b67e077d1558eca0/pa/RC74760_9bd9b26aad7dbbd63f3841854b5b10e1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e6075b79-10fa-5ce8-a74f-84de841b9f57/e6075b79-10fa-5ce8-a74f-84de841b9f57_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64909,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img67/5a/675a145aeb63add0b67e077d1558eca0/pa/RC74760_491788e4667e05721577a2ee46f3a199.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e6075b79-10fa-5ce8-a74f-84de841b9f57/e6075b79-10fa-5ce8-a74f-84de841b9f57_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67074,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img67/5a/675a145aeb63add0b67e077d1558eca0/pa/RC74760_e7c83b90b761e83c14d42ddcec774e72.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e6075b79-10fa-5ce8-a74f-84de841b9f57/e6075b79-10fa-5ce8-a74f-84de841b9f57_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 127451,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img67/5a/675a145aeb63add0b67e077d1558eca0/pa/RC74760_f0eb5e0988d3378044e27006c8b3af8d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e6075b79-10fa-5ce8-a74f-84de841b9f57/e6075b79-10fa-5ce8-a74f-84de841b9f57_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89723,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img67/5a/675a145aeb63add0b67e077d1558eca0/pa/RC74760_a96f1eeb0d76ef9f7885f3c731bb3f9d.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2009-08-13',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 3008 1.6 THP Active',
 'transmission': 'manual',
 'trim': 'Active',
 'year': 2009}
2026-03-27 12:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RC74760%27 HTTP/1.1" 200 None
2026-03-27 12:10:33 [auto1.nl] INFO: Saving data for RC74760: {'created_time': 1774613433.421632, 'last_price_update_time': 1774613433.421642, 'auction_closing_time': 1774716467.0}
2026-03-27 12:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='RC74760') HTTP/1.1" 204 0
2026-03-27 12:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg78%252Fac%252F78acb5626ad2a880cfc7b5d9a1a3ecc2%252Fpa%252FJD39017_39f228202419225f3bbb49e770abc36e.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:10:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/ac/78acb5626ad2a880cfc7b5d9a1a3ecc2/pa/JD39017_39f228202419225f3bbb49e770abc36e.jpg not downloaded yet
2026-03-27 12:10:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 02ae6fc4-df0c-537e-bfeb-79779142b37c with identifier: SY53039
2026-03-27 12:10:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 02ae6fc4-df0c-537e-bfeb-79779142b37c with scrape type 1
2026-03-27 12:10:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 02ae6fc4-df0c-537e-bfeb-79779142b37c
2026-03-27 12:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0f%252Fc7%252F0fc7f4b96d6c761f832997fbab669e9c%252Fpa%252FSY53039_c97caf558b04617c8d3851a9c42876c3.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:10:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0f/c7/0fc7f4b96d6c761f832997fbab669e9c/pa/SY53039_c97caf558b04617c8d3851a9c42876c3.jpg not downloaded yet
2026-03-27 12:10:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7218c6b3-850a-55af-b95d-11797d99af57 with identifier: HA14742
2026-03-27 12:10:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7218c6b3-850a-55af-b95d-11797d99af57 with scrape type 1
2026-03-27 12:10:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 7218c6b3-850a-55af-b95d-11797d99af57
2026-03-27 12:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252Faf%252F1eafd7fe25d766059ffa3f84ac586728%252Fpa%252FHA14742_cc5405454c585b6f9cb49a9d4514f432.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:10:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/af/1eafd7fe25d766059ffa3f84ac586728/pa/HA14742_cc5405454c585b6f9cb49a9d4514f432.jpg not downloaded yet
2026-03-27 12:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg78%252Fac%252F78acb5626ad2a880cfc7b5d9a1a3ecc2%252Fpa%252FJD39017_99a0d490c801b490f3cded313cdbf915.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:10:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/ac/78acb5626ad2a880cfc7b5d9a1a3ecc2/pa/JD39017_99a0d490c801b490f3cded313cdbf915.jpg not downloaded yet
2026-03-27 12:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0f%252Fc7%252F0fc7f4b96d6c761f832997fbab669e9c%252Fpa%252FSY53039_801170b5b882c638ddc93f1cc2fa6d94.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:10:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0f/c7/0fc7f4b96d6c761f832997fbab669e9c/pa/SY53039_801170b5b882c638ddc93f1cc2fa6d94.jpg not downloaded yet
2026-03-27 12:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252Faf%252F1eafd7fe25d766059ffa3f84ac586728%252Fpa%252FHA14742_12a4bc80666ba3545ff991cf8dd2448e.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:10:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/af/1eafd7fe25d766059ffa3f84ac586728/pa/HA14742_12a4bc80666ba3545ff991cf8dd2448e.jpg not downloaded yet
2026-03-27 12:10:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:10:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7cfe1d3050>
2026-03-27 12:10:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:10:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:10:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:10:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fd45af35-8b23-52ea-8cab-b7a8f4c6671d/fd45af35-8b23-52ea-8cab-b7a8f4c6671d_image_1.jpg HTTP/1.1" 201 0
2026-03-27 12:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd3%252Fa1%252Fd3a17b82ad0d3822b1794a1aeec067b2%252Fpa%252FHP44065_1f420d20de04fa7f560e89c26591bb69.jpg') HTTP/1.1" 204 0
2026-03-27 12:10:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/a1/d3a17b82ad0d3822b1794a1aeec067b2/pa/HP44065_1f420d20de04fa7f560e89c26591bb69.jpg saved to cache
2026-03-27 12:10:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item fd45af35-8b23-52ea-8cab-b7a8f4c6671d
2026-03-27 12:10:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:10:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7cfcd9a3d0>
2026-03-27 12:10:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:10:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:10:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:10:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fd45af35-8b23-52ea-8cab-b7a8f4c6671d/fd45af35-8b23-52ea-8cab-b7a8f4c6671d_image_2.jpg HTTP/1.1" 201 0
2026-03-27 12:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd3%252Fa1%252Fd3a17b82ad0d3822b1794a1aeec067b2%252Fpa%252FHP44065_ce12d5a88fac635a5936360ca230ab0a.jpg') HTTP/1.1" 204 0
2026-03-27 12:10:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/a1/d3a17b82ad0d3822b1794a1aeec067b2/pa/HP44065_ce12d5a88fac635a5936360ca230ab0a.jpg saved to cache
2026-03-27 12:10:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item fd45af35-8b23-52ea-8cab-b7a8f4c6671d
2026-03-27 12:10:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:10:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7cfe251d90>
2026-03-27 12:10:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:10:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:10:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:10:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c46c1323-b991-57d9-81ae-bd78bb9d4c4e/c46c1323-b991-57d9-81ae-bd78bb9d4c4e_image_3.jpg HTTP/1.1" 201 0
2026-03-27 12:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg78%252Fac%252F78acb5626ad2a880cfc7b5d9a1a3ecc2%252Fpa%252FJD39017_22adf2c3693daa569d921cc28128cf69.jpg') HTTP/1.1" 204 0
2026-03-27 12:10:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/ac/78acb5626ad2a880cfc7b5d9a1a3ecc2/pa/JD39017_22adf2c3693daa569d921cc28128cf69.jpg saved to cache
2026-03-27 12:10:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c46c1323-b991-57d9-81ae-bd78bb9d4c4e
2026-03-27 12:10:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:10:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7cfdf13550>
2026-03-27 12:10:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:10:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:10:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:10:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1466d57b-48fb-5f7c-bf02-89823f4e64b8/1466d57b-48fb-5f7c-bf02-89823f4e64b8_image_1.jpg HTTP/1.1" 201 0
2026-03-27 12:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf4%252Fcd%252Ff4cd5bd4fd7f87eb72d921bd7846eee6%252Fpa%252FAB34968_6baf6942e39391b10f6c42ccea3752f6.jpg') HTTP/1.1" 204 0
2026-03-27 12:10:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/cd/f4cd5bd4fd7f87eb72d921bd7846eee6/pa/AB34968_6baf6942e39391b10f6c42ccea3752f6.jpg saved to cache
2026-03-27 12:10:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 1466d57b-48fb-5f7c-bf02-89823f4e64b8
2026-03-27 12:10:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:10:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7cfcdcb350>
2026-03-27 12:10:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:10:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:10:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:10:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c46c1323-b991-57d9-81ae-bd78bb9d4c4e/c46c1323-b991-57d9-81ae-bd78bb9d4c4e_image_2.jpg HTTP/1.1" 201 0
2026-03-27 12:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg78%252Fac%252F78acb5626ad2a880cfc7b5d9a1a3ecc2%252Fpa%252FJD39017_b55fcb7567355e34df49a28cc8872bd3.jpg') HTTP/1.1" 204 0
2026-03-27 12:10:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/ac/78acb5626ad2a880cfc7b5d9a1a3ecc2/pa/JD39017_b55fcb7567355e34df49a28cc8872bd3.jpg saved to cache
2026-03-27 12:10:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c46c1323-b991-57d9-81ae-bd78bb9d4c4e
2026-03-27 12:10:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:10:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7cfccca2d0>
2026-03-27 12:10:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:10:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:10:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:10:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c46c1323-b991-57d9-81ae-bd78bb9d4c4e/c46c1323-b991-57d9-81ae-bd78bb9d4c4e_image_1.jpg HTTP/1.1" 201 0
2026-03-27 12:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg78%252Fac%252F78acb5626ad2a880cfc7b5d9a1a3ecc2%252Fpa%252FJD39017_7541e436ca54549a8f15ab4e02907d5d.jpg') HTTP/1.1" 204 0
2026-03-27 12:10:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/ac/78acb5626ad2a880cfc7b5d9a1a3ecc2/pa/JD39017_7541e436ca54549a8f15ab4e02907d5d.jpg saved to cache
2026-03-27 12:10:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c46c1323-b991-57d9-81ae-bd78bb9d4c4e
2026-03-27 12:10:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:10:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7cfdef1fd0>
2026-03-27 12:10:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:10:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:10:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:10:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1466d57b-48fb-5f7c-bf02-89823f4e64b8/1466d57b-48fb-5f7c-bf02-89823f4e64b8_image_2.jpg HTTP/1.1" 201 0
2026-03-27 12:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf4%252Fcd%252Ff4cd5bd4fd7f87eb72d921bd7846eee6%252Fpa%252FAB34968_e709553ca7b6fb3917a87c95fb59ba3c.jpg') HTTP/1.1" 204 0
2026-03-27 12:10:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/cd/f4cd5bd4fd7f87eb72d921bd7846eee6/pa/AB34968_e709553ca7b6fb3917a87c95fb59ba3c.jpg saved to cache
2026-03-27 12:10:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 1466d57b-48fb-5f7c-bf02-89823f4e64b8
2026-03-27 12:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg78%252Fac%252F78acb5626ad2a880cfc7b5d9a1a3ecc2%252Fpa%252FJD39017_dcab0508083a7c3465059d01314e49bd.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:10:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/ac/78acb5626ad2a880cfc7b5d9a1a3ecc2/pa/JD39017_dcab0508083a7c3465059d01314e49bd.jpg not downloaded yet
2026-03-27 12:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0f%252Fc7%252F0fc7f4b96d6c761f832997fbab669e9c%252Fpa%252FSY53039_a1d4704d3b1d573cd736e156dc307656.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:10:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0f/c7/0fc7f4b96d6c761f832997fbab669e9c/pa/SY53039_a1d4704d3b1d573cd736e156dc307656.jpg not downloaded yet
2026-03-27 12:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252Faf%252F1eafd7fe25d766059ffa3f84ac586728%252Fpa%252FHA14742_ca139f98fbca4fc975270c1ac32c88f5.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:10:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/af/1eafd7fe25d766059ffa3f84ac586728/pa/HA14742_ca139f98fbca4fc975270c1ac32c88f5.jpg not downloaded yet
2026-03-27 12:10:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img78/ac/78acb5626ad2a880cfc7b5d9a1a3ecc2/pa/JD39017_f48398212104d506cafddfc9fcd43dbd.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:10:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img78/ac/78acb5626ad2a880cfc7b5d9a1a3ecc2/pa/JD39017_8c7d0547dd629c42d290e5803b7bcf9d.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:10:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgf4/cd/f4cd5bd4fd7f87eb72d921bd7846eee6/pa/AB34968_938053a5b6417a915f147353096307b0.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:10:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd3/a1/d3a17b82ad0d3822b1794a1aeec067b2/pa/HP44065_3578026fae4f7171d84a1726acd531f4.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:10:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0c/d1/0cd189d48170ccc4ca8aeca0f750e844/pa/YZ85937_5fea4a99d476168e19710e160c2a7def.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:10:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0c/d1/0cd189d48170ccc4ca8aeca0f750e844/pa/YZ85937_4cbaef11de832fecb13e43c602ec3cff.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0f%252Fc7%252F0fc7f4b96d6c761f832997fbab669e9c%252Fpa%252FSY53039_9be766df4b88efe8f7a45219466175ec.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:10:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0f/c7/0fc7f4b96d6c761f832997fbab669e9c/pa/SY53039_9be766df4b88efe8f7a45219466175ec.jpg not downloaded yet
2026-03-27 12:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252Faf%252F1eafd7fe25d766059ffa3f84ac586728%252Fpa%252FHA14742_824a4f645a921f58b4f47096fce5fc52.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:10:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/af/1eafd7fe25d766059ffa3f84ac586728/pa/HA14742_824a4f645a921f58b4f47096fce5fc52.jpg not downloaded yet
2026-03-27 12:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0f%252Fc7%252F0fc7f4b96d6c761f832997fbab669e9c%252Fpa%252FSY53039_d08462e242ac494ddba2f8dcb360d63e.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:10:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0f/c7/0fc7f4b96d6c761f832997fbab669e9c/pa/SY53039_d08462e242ac494ddba2f8dcb360d63e.jpg not downloaded yet
2026-03-27 12:10:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252Faf%252F1eafd7fe25d766059ffa3f84ac586728%252Fpa%252FHA14742_7aba7bd82321365dbd008d1e623ed69c.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:10:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/af/1eafd7fe25d766059ffa3f84ac586728/pa/HA14742_7aba7bd82321365dbd008d1e623ed69c.jpg not downloaded yet
2026-03-27 12:10:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NV18219/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 12:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0f%252Fc7%252F0fc7f4b96d6c761f832997fbab669e9c%252Fpa%252FSY53039_2cbf6d4e3f5f9889abd3aa92a1e305b4.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:10:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0f/c7/0fc7f4b96d6c761f832997fbab669e9c/pa/SY53039_2cbf6d4e3f5f9889abd3aa92a1e305b4.jpg not downloaded yet
2026-03-27 12:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252Faf%252F1eafd7fe25d766059ffa3f84ac586728%252Fpa%252FHA14742_aead33d45333115910cddfd7785d62c1.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:10:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/af/1eafd7fe25d766059ffa3f84ac586728/pa/HA14742_aead33d45333115910cddfd7785d62c1.jpg not downloaded yet
2026-03-27 12:10:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 12:10:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WU34213/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 12:10:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img78/ac/78acb5626ad2a880cfc7b5d9a1a3ecc2/pa/JD39017_99a0d490c801b490f3cded313cdbf915.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0f%252Fc7%252F0fc7f4b96d6c761f832997fbab669e9c%252Fpa%252FSY53039_931c575baed52dc47c74545223a5e8b5.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:10:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0f/c7/0fc7f4b96d6c761f832997fbab669e9c/pa/SY53039_931c575baed52dc47c74545223a5e8b5.jpg not downloaded yet
2026-03-27 12:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252Faf%252F1eafd7fe25d766059ffa3f84ac586728%252Fpa%252FHA14742_f204816fb677d5bcdd9b0957652b37fb.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:10:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/af/1eafd7fe25d766059ffa3f84ac586728/pa/HA14742_f204816fb677d5bcdd9b0957652b37fb.jpg not downloaded yet
2026-03-27 12:10:34 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 12:10:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:10:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7cfe07e410>
2026-03-27 12:10:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:10:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:10:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:10:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c46c1323-b991-57d9-81ae-bd78bb9d4c4e/c46c1323-b991-57d9-81ae-bd78bb9d4c4e_image_5.jpg HTTP/1.1" 201 0
2026-03-27 12:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg78%252Fac%252F78acb5626ad2a880cfc7b5d9a1a3ecc2%252Fpa%252FJD39017_f48398212104d506cafddfc9fcd43dbd.jpg') HTTP/1.1" 204 0
2026-03-27 12:10:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/ac/78acb5626ad2a880cfc7b5d9a1a3ecc2/pa/JD39017_f48398212104d506cafddfc9fcd43dbd.jpg saved to cache
2026-03-27 12:10:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c46c1323-b991-57d9-81ae-bd78bb9d4c4e
2026-03-27 12:10:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:10:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7cfdefbad0>
2026-03-27 12:10:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:10:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:10:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:10:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c46c1323-b991-57d9-81ae-bd78bb9d4c4e/c46c1323-b991-57d9-81ae-bd78bb9d4c4e_image_4.jpg HTTP/1.1" 201 0
2026-03-27 12:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg78%252Fac%252F78acb5626ad2a880cfc7b5d9a1a3ecc2%252Fpa%252FJD39017_8c7d0547dd629c42d290e5803b7bcf9d.jpg') HTTP/1.1" 204 0
2026-03-27 12:10:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/ac/78acb5626ad2a880cfc7b5d9a1a3ecc2/pa/JD39017_8c7d0547dd629c42d290e5803b7bcf9d.jpg saved to cache
2026-03-27 12:10:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c46c1323-b991-57d9-81ae-bd78bb9d4c4e
2026-03-27 12:10:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:10:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7cfdfe9610>
2026-03-27 12:10:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:10:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:10:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:10:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1466d57b-48fb-5f7c-bf02-89823f4e64b8/1466d57b-48fb-5f7c-bf02-89823f4e64b8_image_0.jpg HTTP/1.1" 201 0
2026-03-27 12:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgf4%252Fcd%252Ff4cd5bd4fd7f87eb72d921bd7846eee6%252Fpa%252FAB34968_938053a5b6417a915f147353096307b0.jpg') HTTP/1.1" 204 0
2026-03-27 12:10:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgf4/cd/f4cd5bd4fd7f87eb72d921bd7846eee6/pa/AB34968_938053a5b6417a915f147353096307b0.jpg saved to cache
2026-03-27 12:10:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1466d57b-48fb-5f7c-bf02-89823f4e64b8
2026-03-27 12:10:34 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1466d57b-48fb-5f7c-bf02-89823f4e64b8, skipping ID generation
2026-03-27 12:10:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1466d57b-48fb-5f7c-bf02-89823f4e64b8 with scrape type 1
2026-03-27 12:10:34 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1466d57b-48fb-5f7c-bf02-89823f4e64b8 sending to next pipeline
2026-03-27 12:10:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 1466d57b-48fb-5f7c-bf02-89823f4e64b8, identifier: AB34968
2026-03-27 12:10:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:10:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7cfe0e09d0>
2026-03-27 12:10:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:10:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:10:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:10:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fd45af35-8b23-52ea-8cab-b7a8f4c6671d/fd45af35-8b23-52ea-8cab-b7a8f4c6671d_image_0.jpg HTTP/1.1" 201 0
2026-03-27 12:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd3%252Fa1%252Fd3a17b82ad0d3822b1794a1aeec067b2%252Fpa%252FHP44065_3578026fae4f7171d84a1726acd531f4.jpg') HTTP/1.1" 204 0
2026-03-27 12:10:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd3/a1/d3a17b82ad0d3822b1794a1aeec067b2/pa/HP44065_3578026fae4f7171d84a1726acd531f4.jpg saved to cache
2026-03-27 12:10:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item fd45af35-8b23-52ea-8cab-b7a8f4c6671d
2026-03-27 12:10:34 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: fd45af35-8b23-52ea-8cab-b7a8f4c6671d, skipping ID generation
2026-03-27 12:10:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fd45af35-8b23-52ea-8cab-b7a8f4c6671d with scrape type 1
2026-03-27 12:10:34 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item fd45af35-8b23-52ea-8cab-b7a8f4c6671d sending to next pipeline
2026-03-27 12:10:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: fd45af35-8b23-52ea-8cab-b7a8f4c6671d, identifier: HP44065
2026-03-27 12:10:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:10:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7cfdf00cd0>
2026-03-27 12:10:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:10:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:10:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:10:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a4119aee-b299-554e-a3e1-8b46b6b38066/a4119aee-b299-554e-a3e1-8b46b6b38066_image_3.jpg HTTP/1.1" 201 0
2026-03-27 12:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252Fd1%252F0cd189d48170ccc4ca8aeca0f750e844%252Fpa%252FYZ85937_5fea4a99d476168e19710e160c2a7def.jpg') HTTP/1.1" 204 0
2026-03-27 12:10:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/d1/0cd189d48170ccc4ca8aeca0f750e844/pa/YZ85937_5fea4a99d476168e19710e160c2a7def.jpg saved to cache
2026-03-27 12:10:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a4119aee-b299-554e-a3e1-8b46b6b38066
2026-03-27 12:10:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:10:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7cfccf0a50>
2026-03-27 12:10:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:10:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:10:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:10:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a4119aee-b299-554e-a3e1-8b46b6b38066/a4119aee-b299-554e-a3e1-8b46b6b38066_image_2.jpg HTTP/1.1" 201 0
2026-03-27 12:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0c%252Fd1%252F0cd189d48170ccc4ca8aeca0f750e844%252Fpa%252FYZ85937_4cbaef11de832fecb13e43c602ec3cff.jpg') HTTP/1.1" 204 0
2026-03-27 12:10:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0c/d1/0cd189d48170ccc4ca8aeca0f750e844/pa/YZ85937_4cbaef11de832fecb13e43c602ec3cff.jpg saved to cache
2026-03-27 12:10:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a4119aee-b299-554e-a3e1-8b46b6b38066
2026-03-27 12:10:34 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a4119aee-b299-554e-a3e1-8b46b6b38066, skipping ID generation
2026-03-27 12:10:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a4119aee-b299-554e-a3e1-8b46b6b38066 with scrape type 1
2026-03-27 12:10:34 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a4119aee-b299-554e-a3e1-8b46b6b38066 sending to next pipeline
2026-03-27 12:10:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: a4119aee-b299-554e-a3e1-8b46b6b38066, identifier: YZ85937
2026-03-27 12:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0f%252Fc7%252F0fc7f4b96d6c761f832997fbab669e9c%252Fpa%252FSY53039_a2a33313d92874bad438b0d6a0302234.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:10:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0f/c7/0fc7f4b96d6c761f832997fbab669e9c/pa/SY53039_a2a33313d92874bad438b0d6a0302234.jpg not downloaded yet
2026-03-27 12:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252Faf%252F1eafd7fe25d766059ffa3f84ac586728%252Fpa%252FHA14742_3d1f2a316e08c6c32e291337fc9fd76f.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:10:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/af/1eafd7fe25d766059ffa3f84ac586728/pa/HA14742_3d1f2a316e08c6c32e291337fc9fd76f.jpg not downloaded yet
2026-03-27 12:10:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 1466d57b-48fb-5f7c-bf02-89823f4e64b8 with identifier: AB34968
2026-03-27 12:10:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 1466d57b-48fb-5f7c-bf02-89823f4e64b8 with identifier: AB34968
2026-03-27 12:10:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 1466d57b-48fb-5f7c-bf02-89823f4e64b8 with identifier: AB34968 to the API
2026-03-27 12:10:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 12:10:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 12:10:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgf4/cd/f4cd5bd4fd7f87eb72d921bd7846eee6/pa/AB34968_938053a5b6417a915f147353096307b0.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 110,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.4L',
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:05:18Z',
 'fuel_type': 'petrol',
 'id': '1466d57b-48fb-5f7c-bf02-89823f4e64b8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': '61ZVN4',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AB34968',
 'listing': 'auction',
 'location': 'NL, Arnhem',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 211460,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1466d57b-48fb-5f7c-bf02-89823f4e64b8/1466d57b-48fb-5f7c-bf02-89823f4e64b8_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 107497,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf4/cd/f4cd5bd4fd7f87eb72d921bd7846eee6/pa/AB34968_938053a5b6417a915f147353096307b0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1466d57b-48fb-5f7c-bf02-89823f4e64b8/1466d57b-48fb-5f7c-bf02-89823f4e64b8_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 98464,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf4/cd/f4cd5bd4fd7f87eb72d921bd7846eee6/pa/AB34968_6baf6942e39391b10f6c42ccea3752f6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1466d57b-48fb-5f7c-bf02-89823f4e64b8/1466d57b-48fb-5f7c-bf02-89823f4e64b8_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 105208,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf4/cd/f4cd5bd4fd7f87eb72d921bd7846eee6/pa/AB34968_e709553ca7b6fb3917a87c95fb59ba3c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1466d57b-48fb-5f7c-bf02-89823f4e64b8/1466d57b-48fb-5f7c-bf02-89823f4e64b8_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77002,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf4/cd/f4cd5bd4fd7f87eb72d921bd7846eee6/pa/AB34968_2b59417b32b09f86f010b6ef2bc2e072.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1466d57b-48fb-5f7c-bf02-89823f4e64b8/1466d57b-48fb-5f7c-bf02-89823f4e64b8_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 95808,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf4/cd/f4cd5bd4fd7f87eb72d921bd7846eee6/pa/AB34968_53f80ba0422e25d635340307ac1d7b65.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1466d57b-48fb-5f7c-bf02-89823f4e64b8/1466d57b-48fb-5f7c-bf02-89823f4e64b8_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 101418,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf4/cd/f4cd5bd4fd7f87eb72d921bd7846eee6/pa/AB34968_29db6b243f100d626208c7f785785ab3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1466d57b-48fb-5f7c-bf02-89823f4e64b8/1466d57b-48fb-5f7c-bf02-89823f4e64b8_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81692,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf4/cd/f4cd5bd4fd7f87eb72d921bd7846eee6/pa/AB34968_0f13e352da63b545695dca71e59ddcbe.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1466d57b-48fb-5f7c-bf02-89823f4e64b8/1466d57b-48fb-5f7c-bf02-89823f4e64b8_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 95978,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf4/cd/f4cd5bd4fd7f87eb72d921bd7846eee6/pa/AB34968_5db592d1c004482386d7e883e392da30.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1466d57b-48fb-5f7c-bf02-89823f4e64b8/1466d57b-48fb-5f7c-bf02-89823f4e64b8_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 99752,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf4/cd/f4cd5bd4fd7f87eb72d921bd7846eee6/pa/AB34968_5f42967f039868ad185256127b068fb9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1466d57b-48fb-5f7c-bf02-89823f4e64b8/1466d57b-48fb-5f7c-bf02-89823f4e64b8_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89974,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgf4/cd/f4cd5bd4fd7f87eb72d921bd7846eee6/pa/AB34968_e54430657cea3ffdbf6e8e6b61f6cb25.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2013-02-21',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Golf VII 1.4 TSI ACT Highline BlueMotion Tech',
 'transmission': 'automatic',
 'trim': 'Highline BlueMotion Tech',
 'year': 2013}
2026-03-27 12:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AB34968%27 HTTP/1.1" 200 None
2026-03-27 12:10:35 [auto1.nl] INFO: Saving data for AB34968: {'created_time': 1774613435.096347, 'last_price_update_time': 1774613435.096358, 'auction_closing_time': 1774713918.0}
2026-03-27 12:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='AB34968') HTTP/1.1" 204 0
2026-03-27 12:10:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: fd45af35-8b23-52ea-8cab-b7a8f4c6671d with identifier: HP44065
2026-03-27 12:10:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: fd45af35-8b23-52ea-8cab-b7a8f4c6671d with identifier: HP44065
2026-03-27 12:10:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: fd45af35-8b23-52ea-8cab-b7a8f4c6671d with identifier: HP44065 to the API
2026-03-27 12:10:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 12:10:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 12:10:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgd3/a1/d3a17b82ad0d3822b1794a1aeec067b2/pa/HP44065_3578026fae4f7171d84a1726acd531f4.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 95,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.0L',
 'engine_horse_power': 70,
 'expiration_date': '2026-03-28T16:09:35Z',
 'fuel_type': 'petrol',
 'id': 'fd45af35-8b23-52ea-8cab-b7a8f4c6671d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'GB339R',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HP44065',
 'listing': 'auction',
 'location': 'NL, Rotterdam',
 'make': 'Kia',
 'model': 'Picanto',
 'odometer': 263415,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fd45af35-8b23-52ea-8cab-b7a8f4c6671d/fd45af35-8b23-52ea-8cab-b7a8f4c6671d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73120,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd3/a1/d3a17b82ad0d3822b1794a1aeec067b2/pa/HP44065_3578026fae4f7171d84a1726acd531f4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fd45af35-8b23-52ea-8cab-b7a8f4c6671d/fd45af35-8b23-52ea-8cab-b7a8f4c6671d_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76238,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd3/a1/d3a17b82ad0d3822b1794a1aeec067b2/pa/HP44065_1f420d20de04fa7f560e89c26591bb69.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fd45af35-8b23-52ea-8cab-b7a8f4c6671d/fd45af35-8b23-52ea-8cab-b7a8f4c6671d_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74458,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd3/a1/d3a17b82ad0d3822b1794a1aeec067b2/pa/HP44065_ce12d5a88fac635a5936360ca230ab0a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fd45af35-8b23-52ea-8cab-b7a8f4c6671d/fd45af35-8b23-52ea-8cab-b7a8f4c6671d_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88706,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd3/a1/d3a17b82ad0d3822b1794a1aeec067b2/pa/HP44065_31f578763c14aeb611ea866ef0c50221.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fd45af35-8b23-52ea-8cab-b7a8f4c6671d/fd45af35-8b23-52ea-8cab-b7a8f4c6671d_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 118113,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd3/a1/d3a17b82ad0d3822b1794a1aeec067b2/pa/HP44065_279dd40f06f3aaa45e23ba2e561b1e0e.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2015-04-08',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Kia Picanto 1.0 Active',
 'transmission': 'manual',
 'trim': 'Active',
 'year': 2015}
2026-03-27 12:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HP44065%27 HTTP/1.1" 200 None
2026-03-27 12:10:35 [auto1.nl] INFO: Saving data for HP44065: {'created_time': 1774613435.484141, 'last_price_update_time': 1774613435.484157, 'auction_closing_time': 1774714175.0}
2026-03-27 12:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='HP44065') HTTP/1.1" 204 0
2026-03-27 12:10:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: a4119aee-b299-554e-a3e1-8b46b6b38066 with identifier: YZ85937
2026-03-27 12:10:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: a4119aee-b299-554e-a3e1-8b46b6b38066 with identifier: YZ85937
2026-03-27 12:10:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: a4119aee-b299-554e-a3e1-8b46b6b38066 with identifier: YZ85937 to the API
2026-03-27 12:10:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 12:10:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 12:10:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img0c/d1/0cd189d48170ccc4ca8aeca0f750e844/pa/YZ85937_4cbaef11de832fecb13e43c602ec3cff.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 163,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 3',
 'engine': '1.6L',
 'engine_horse_power': 113,
 'expiration_date': '2026-03-28T16:34:16Z',
 'fuel_type': 'petrol',
 'id': 'a4119aee-b299-554e-a3e1-8b46b6b38066',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': '32SHKF',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YZ85937',
 'listing': 'auction',
 'location': 'NL, Eindhoven',
 'make': 'Renault',
 'model': 'Megane',
 'odometer': 999999,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a4119aee-b299-554e-a3e1-8b46b6b38066/a4119aee-b299-554e-a3e1-8b46b6b38066_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 94636,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0c/d1/0cd189d48170ccc4ca8aeca0f750e844/pa/YZ85937_bda375d1e85843ac8ffd196dcdd7d8d4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a4119aee-b299-554e-a3e1-8b46b6b38066/a4119aee-b299-554e-a3e1-8b46b6b38066_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 87815,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0c/d1/0cd189d48170ccc4ca8aeca0f750e844/pa/YZ85937_71f129c30d30234d69d90eeff87b75a7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a4119aee-b299-554e-a3e1-8b46b6b38066/a4119aee-b299-554e-a3e1-8b46b6b38066_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78298,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0c/d1/0cd189d48170ccc4ca8aeca0f750e844/pa/YZ85937_4cbaef11de832fecb13e43c602ec3cff.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a4119aee-b299-554e-a3e1-8b46b6b38066/a4119aee-b299-554e-a3e1-8b46b6b38066_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75408,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0c/d1/0cd189d48170ccc4ca8aeca0f750e844/pa/YZ85937_5fea4a99d476168e19710e160c2a7def.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a4119aee-b299-554e-a3e1-8b46b6b38066/a4119aee-b299-554e-a3e1-8b46b6b38066_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72458,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0c/d1/0cd189d48170ccc4ca8aeca0f750e844/pa/YZ85937_f8adba2f1d870859ad26b67b7e2d0848.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2006-01-05',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Renault Megane 1.6 Sportway',
 'transmission': 'manual',
 'trim': 'Sportway',
 'year': 2006}
2026-03-27 12:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YZ85937%27 HTTP/1.1" 200 None
2026-03-27 12:10:35 [auto1.nl] INFO: Saving data for YZ85937: {'created_time': 1774613435.854893, 'last_price_update_time': 1774613435.854903, 'auction_closing_time': 1774715656.0}
2026-03-27 12:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='YZ85937') HTTP/1.1" 204 0
2026-03-27 12:10:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1e/af/1eafd7fe25d766059ffa3f84ac586728/pa/HA14742_12a4bc80666ba3545ff991cf8dd2448e.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:10:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1e/af/1eafd7fe25d766059ffa3f84ac586728/pa/HA14742_aead33d45333115910cddfd7785d62c1.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:10:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0f/c7/0fc7f4b96d6c761f832997fbab669e9c/pa/SY53039_801170b5b882c638ddc93f1cc2fa6d94.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0f%252Fc7%252F0fc7f4b96d6c761f832997fbab669e9c%252Fpa%252FSY53039_2596e41c88c0d83fa63003c8bc5842f8.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:10:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0f/c7/0fc7f4b96d6c761f832997fbab669e9c/pa/SY53039_2596e41c88c0d83fa63003c8bc5842f8.jpg not downloaded yet
2026-03-27 12:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252Faf%252F1eafd7fe25d766059ffa3f84ac586728%252Fpa%252FHA14742_3a893b1aa37adc1b2e1fc12b4e52e92a.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:10:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/af/1eafd7fe25d766059ffa3f84ac586728/pa/HA14742_3a893b1aa37adc1b2e1fc12b4e52e92a.jpg not downloaded yet
2026-03-27 12:10:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BU15419> (referer: https://www.auto1.com/v1/car-details-view/BU15419/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 12:10:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ST70882> (referer: https://www.auto1.com/v1/car-details-view/ST70882/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 12:10:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FK39304> (referer: https://www.auto1.com/v1/car-details-view/FK39304/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 12:10:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/TC15988> (referer: https://www.auto1.com/v1/car-details-view/TC15988/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 12:10:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BW44039/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 12:10:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:10:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7cfe25ce10>
2026-03-27 12:10:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:10:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:10:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:10:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c46c1323-b991-57d9-81ae-bd78bb9d4c4e/c46c1323-b991-57d9-81ae-bd78bb9d4c4e_image_8.jpg HTTP/1.1" 201 0
2026-03-27 12:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg78%252Fac%252F78acb5626ad2a880cfc7b5d9a1a3ecc2%252Fpa%252FJD39017_99a0d490c801b490f3cded313cdbf915.jpg') HTTP/1.1" 204 0
2026-03-27 12:10:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/ac/78acb5626ad2a880cfc7b5d9a1a3ecc2/pa/JD39017_99a0d490c801b490f3cded313cdbf915.jpg saved to cache
2026-03-27 12:10:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item c46c1323-b991-57d9-81ae-bd78bb9d4c4e
2026-03-27 12:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0f%252Fc7%252F0fc7f4b96d6c761f832997fbab669e9c%252Fpa%252FSY53039_5e20e69232f7d467b35c97b1297af140.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:10:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0f/c7/0fc7f4b96d6c761f832997fbab669e9c/pa/SY53039_5e20e69232f7d467b35c97b1297af140.jpg not downloaded yet
2026-03-27 12:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252Faf%252F1eafd7fe25d766059ffa3f84ac586728%252Fpa%252FHA14742_8a02d5750f9b44fad725fdc29001c72c.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:10:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/af/1eafd7fe25d766059ffa3f84ac586728/pa/HA14742_8a02d5750f9b44fad725fdc29001c72c.jpg not downloaded yet
2026-03-27 12:10:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 12:10:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 12:10:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:10:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7cfeea4650>
2026-03-27 12:10:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:10:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:10:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:10:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7218c6b3-850a-55af-b95d-11797d99af57/7218c6b3-850a-55af-b95d-11797d99af57_image_1.jpg HTTP/1.1" 201 0
2026-03-27 12:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252Faf%252F1eafd7fe25d766059ffa3f84ac586728%252Fpa%252FHA14742_12a4bc80666ba3545ff991cf8dd2448e.jpg') HTTP/1.1" 204 0
2026-03-27 12:10:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/af/1eafd7fe25d766059ffa3f84ac586728/pa/HA14742_12a4bc80666ba3545ff991cf8dd2448e.jpg saved to cache
2026-03-27 12:10:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 7218c6b3-850a-55af-b95d-11797d99af57
2026-03-27 12:10:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:10:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7cfe294a90>
2026-03-27 12:10:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:10:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:10:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:10:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7218c6b3-850a-55af-b95d-11797d99af57/7218c6b3-850a-55af-b95d-11797d99af57_image_5.jpg HTTP/1.1" 201 0
2026-03-27 12:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252Faf%252F1eafd7fe25d766059ffa3f84ac586728%252Fpa%252FHA14742_aead33d45333115910cddfd7785d62c1.jpg') HTTP/1.1" 204 0
2026-03-27 12:10:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/af/1eafd7fe25d766059ffa3f84ac586728/pa/HA14742_aead33d45333115910cddfd7785d62c1.jpg saved to cache
2026-03-27 12:10:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 7218c6b3-850a-55af-b95d-11797d99af57
2026-03-27 12:10:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:10:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7d00003f90>
2026-03-27 12:10:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:10:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:10:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:10:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_02ae6fc4-df0c-537e-bfeb-79779142b37c/02ae6fc4-df0c-537e-bfeb-79779142b37c_image_1.jpg HTTP/1.1" 201 0
2026-03-27 12:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0f%252Fc7%252F0fc7f4b96d6c761f832997fbab669e9c%252Fpa%252FSY53039_801170b5b882c638ddc93f1cc2fa6d94.jpg') HTTP/1.1" 204 0
2026-03-27 12:10:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0f/c7/0fc7f4b96d6c761f832997fbab669e9c/pa/SY53039_801170b5b882c638ddc93f1cc2fa6d94.jpg saved to cache
2026-03-27 12:10:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 02ae6fc4-df0c-537e-bfeb-79779142b37c
2026-03-27 12:10:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1e/af/1eafd7fe25d766059ffa3f84ac586728/pa/HA14742_3d1f2a316e08c6c32e291337fc9fd76f.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:10:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1e/af/1eafd7fe25d766059ffa3f84ac586728/pa/HA14742_f204816fb677d5bcdd9b0957652b37fb.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:10:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0f/c7/0fc7f4b96d6c761f832997fbab669e9c/pa/SY53039_a2a33313d92874bad438b0d6a0302234.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:10:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c076bccc-b1c9-5648-ba84-ce5655f6a574 with identifier: BU15419
2026-03-27 12:10:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c076bccc-b1c9-5648-ba84-ce5655f6a574 with scrape type 1
2026-03-27 12:10:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c076bccc-b1c9-5648-ba84-ce5655f6a574
2026-03-27 12:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg64%252F03%252F6403adf8c3ca1f9c7a595baf1d46d898%252Fpa%252FBU15419_2b1645ecf055b1d6451738cecfdceb3b.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:10:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/03/6403adf8c3ca1f9c7a595baf1d46d898/pa/BU15419_2b1645ecf055b1d6451738cecfdceb3b.jpg already downloaded
2026-03-27 12:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg64%252F03%252F6403adf8c3ca1f9c7a595baf1d46d898%252Fpa%252FBU15419_4b623bdccbc2ce9a79b174dad078bd56.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:10:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/03/6403adf8c3ca1f9c7a595baf1d46d898/pa/BU15419_4b623bdccbc2ce9a79b174dad078bd56.jpg already downloaded
2026-03-27 12:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg64%252F03%252F6403adf8c3ca1f9c7a595baf1d46d898%252Fpa%252FBU15419_5fdf190c22ead06cb50b78f8a4e4543f.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:10:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/03/6403adf8c3ca1f9c7a595baf1d46d898/pa/BU15419_5fdf190c22ead06cb50b78f8a4e4543f.jpg already downloaded
2026-03-27 12:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg64%252F03%252F6403adf8c3ca1f9c7a595baf1d46d898%252Fpa%252FBU15419_598f7ec63d015199697a85584f804e51.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:10:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/03/6403adf8c3ca1f9c7a595baf1d46d898/pa/BU15419_598f7ec63d015199697a85584f804e51.jpg already downloaded
2026-03-27 12:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg64%252F03%252F6403adf8c3ca1f9c7a595baf1d46d898%252Fpa%252FBU15419_f170faf71da94ea8de3e5e36ec1adebd.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:10:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/03/6403adf8c3ca1f9c7a595baf1d46d898/pa/BU15419_f170faf71da94ea8de3e5e36ec1adebd.jpg already downloaded
2026-03-27 12:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg64%252F03%252F6403adf8c3ca1f9c7a595baf1d46d898%252Fpa%252FBU15419_afa43b65cfe370b996ac82eaa081beff.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:10:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/03/6403adf8c3ca1f9c7a595baf1d46d898/pa/BU15419_afa43b65cfe370b996ac82eaa081beff.jpg already downloaded
2026-03-27 12:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg64%252F03%252F6403adf8c3ca1f9c7a595baf1d46d898%252Fpa%252FBU15419_4d004c00066e12ee5f0052ee4a2f6e2f.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:10:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/03/6403adf8c3ca1f9c7a595baf1d46d898/pa/BU15419_4d004c00066e12ee5f0052ee4a2f6e2f.jpg already downloaded
2026-03-27 12:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg64%252F03%252F6403adf8c3ca1f9c7a595baf1d46d898%252Fpa%252FBU15419_9e0f2d6e73a9d6c7405864689e857f4d.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:10:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/03/6403adf8c3ca1f9c7a595baf1d46d898/pa/BU15419_9e0f2d6e73a9d6c7405864689e857f4d.jpg already downloaded
2026-03-27 12:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg64%252F03%252F6403adf8c3ca1f9c7a595baf1d46d898%252Fpa%252FBU15419_230d834238fb50eca9d95419287db3b4.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:10:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/03/6403adf8c3ca1f9c7a595baf1d46d898/pa/BU15419_230d834238fb50eca9d95419287db3b4.jpg already downloaded
2026-03-27 12:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg64%252F03%252F6403adf8c3ca1f9c7a595baf1d46d898%252Fpa%252FBU15419_ee10ad623f29854aec1e3099636cd58c.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:10:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/03/6403adf8c3ca1f9c7a595baf1d46d898/pa/BU15419_ee10ad623f29854aec1e3099636cd58c.jpg already downloaded
2026-03-27 12:10:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: c076bccc-b1c9-5648-ba84-ce5655f6a574, identifier: BU15419
2026-03-27 12:10:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e4cf93ee-ae4b-5a94-a142-2495a0f3d548 with identifier: ST70882
2026-03-27 12:10:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e4cf93ee-ae4b-5a94-a142-2495a0f3d548 with scrape type 1
2026-03-27 12:10:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item e4cf93ee-ae4b-5a94-a142-2495a0f3d548
2026-03-27 12:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd1%252Fa8%252Fd1a8c3e162d76c7cb16d29605c4f5ea3%252Fpa%252FST70882_7d746e14799ae52f6cc2f208e616678a.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:10:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd1/a8/d1a8c3e162d76c7cb16d29605c4f5ea3/pa/ST70882_7d746e14799ae52f6cc2f208e616678a.jpg not downloaded yet
2026-03-27 12:10:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: aaeb7602-4138-550e-88fa-de8627c49056 with identifier: FK39304
2026-03-27 12:10:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item aaeb7602-4138-550e-88fa-de8627c49056 with scrape type 1
2026-03-27 12:10:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item aaeb7602-4138-550e-88fa-de8627c49056
2026-03-27 12:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252F9d%252F969d1a04c2996f89d3e4f893f4070169%252Fpa%252FFK39304_d348adefa177e88d0d34d9c347edc5a7.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:10:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/9d/969d1a04c2996f89d3e4f893f4070169/pa/FK39304_d348adefa177e88d0d34d9c347edc5a7.jpg not downloaded yet
2026-03-27 12:10:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cd61cbb9-f227-5599-9f83-2942b52c0271 with identifier: TC15988
2026-03-27 12:10:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cd61cbb9-f227-5599-9f83-2942b52c0271 with scrape type 1
2026-03-27 12:10:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item cd61cbb9-f227-5599-9f83-2942b52c0271
2026-03-27 12:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252F82%252F0a82ee1313168cc8a05608daf86a9ee3%252Fpa%252FTC15988_7c6a7c850f19b831f40b33463744c838.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:10:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/82/0a82ee1313168cc8a05608daf86a9ee3/pa/TC15988_7c6a7c850f19b831f40b33463744c838.jpg already downloaded
2026-03-27 12:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252F82%252F0a82ee1313168cc8a05608daf86a9ee3%252Fpa%252FTC15988_43f745ee1519af6a37600cb1bedd8e9c.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:10:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/82/0a82ee1313168cc8a05608daf86a9ee3/pa/TC15988_43f745ee1519af6a37600cb1bedd8e9c.jpg already downloaded
2026-03-27 12:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252F82%252F0a82ee1313168cc8a05608daf86a9ee3%252Fpa%252FTC15988_501d32fdb5affceee31410bf1f982670.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:10:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/82/0a82ee1313168cc8a05608daf86a9ee3/pa/TC15988_501d32fdb5affceee31410bf1f982670.jpg already downloaded
2026-03-27 12:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252F82%252F0a82ee1313168cc8a05608daf86a9ee3%252Fpa%252FTC15988_6ed3156509f8ec3f114af2eec5fbf8a2.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:10:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/82/0a82ee1313168cc8a05608daf86a9ee3/pa/TC15988_6ed3156509f8ec3f114af2eec5fbf8a2.jpg already downloaded
2026-03-27 12:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252F82%252F0a82ee1313168cc8a05608daf86a9ee3%252Fpa%252FTC15988_de760d6649e50b9f49c62b51fd9b4b09.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:10:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/82/0a82ee1313168cc8a05608daf86a9ee3/pa/TC15988_de760d6649e50b9f49c62b51fd9b4b09.jpg already downloaded
2026-03-27 12:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252F82%252F0a82ee1313168cc8a05608daf86a9ee3%252Fpa%252FTC15988_8fe819fb66a518193a7b4cc786482e08.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:10:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/82/0a82ee1313168cc8a05608daf86a9ee3/pa/TC15988_8fe819fb66a518193a7b4cc786482e08.jpg already downloaded
2026-03-27 12:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252F82%252F0a82ee1313168cc8a05608daf86a9ee3%252Fpa%252FTC15988_dc916da9d0bd8c34ade781d7e5d1f175.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:10:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/82/0a82ee1313168cc8a05608daf86a9ee3/pa/TC15988_dc916da9d0bd8c34ade781d7e5d1f175.jpg already downloaded
2026-03-27 12:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252F82%252F0a82ee1313168cc8a05608daf86a9ee3%252Fpa%252FTC15988_6f08c82a80480a5238a464cd6edf2c11.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:10:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/82/0a82ee1313168cc8a05608daf86a9ee3/pa/TC15988_6f08c82a80480a5238a464cd6edf2c11.jpg already downloaded
2026-03-27 12:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252F82%252F0a82ee1313168cc8a05608daf86a9ee3%252Fpa%252FTC15988_4df32acad7f631951f8f16dbdf4c2d6f.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:10:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/82/0a82ee1313168cc8a05608daf86a9ee3/pa/TC15988_4df32acad7f631951f8f16dbdf4c2d6f.jpg already downloaded
2026-03-27 12:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg0a%252F82%252F0a82ee1313168cc8a05608daf86a9ee3%252Fpa%252FTC15988_3120569b8eb0e6a48a44645e57fc38dd.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:10:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0a/82/0a82ee1313168cc8a05608daf86a9ee3/pa/TC15988_3120569b8eb0e6a48a44645e57fc38dd.jpg already downloaded
2026-03-27 12:10:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: cd61cbb9-f227-5599-9f83-2942b52c0271, identifier: TC15988
2026-03-27 12:10:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: c076bccc-b1c9-5648-ba84-ce5655f6a574 with identifier: BU15419
2026-03-27 12:10:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: c076bccc-b1c9-5648-ba84-ce5655f6a574 with identifier: BU15419
2026-03-27 12:10:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: c076bccc-b1c9-5648-ba84-ce5655f6a574 with identifier: BU15419 to the API
2026-03-27 12:10:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 12:10:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 12:10:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/BU15419>
{'auction_title': '',
 'c_o_2_emission_value': 115,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 131,
 'expiration_date': '2026-03-28T16:52:10Z',
 'fuel_type': 'petrol',
 'id': 'c076bccc-b1c9-5648-ba84-ce5655f6a574',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'PH268G',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BU15419',
 'listing': 'auction',
 'location': 'NL, Oosterhout',
 'make': 'Peugeot',
 'model': '3008',
 'odometer': 239367,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img64/03/6403adf8c3ca1f9c7a595baf1d46d898/pa/BU15419_2b1645ecf055b1d6451738cecfdceb3b.jpg',
                'https://img-pa.auto1.com/img64/03/6403adf8c3ca1f9c7a595baf1d46d898/pa/BU15419_4b623bdccbc2ce9a79b174dad078bd56.jpg',
                'https://img-pa.auto1.com/img64/03/6403adf8c3ca1f9c7a595baf1d46d898/pa/BU15419_5fdf190c22ead06cb50b78f8a4e4543f.jpg',
                'https://img-pa.auto1.com/img64/03/6403adf8c3ca1f9c7a595baf1d46d898/pa/BU15419_598f7ec63d015199697a85584f804e51.jpg',
                'https://img-pa.auto1.com/img64/03/6403adf8c3ca1f9c7a595baf1d46d898/pa/BU15419_f170faf71da94ea8de3e5e36ec1adebd.jpg',
                'https://img-pa.auto1.com/img64/03/6403adf8c3ca1f9c7a595baf1d46d898/pa/BU15419_afa43b65cfe370b996ac82eaa081beff.jpg',
                'https://img-pa.auto1.com/img64/03/6403adf8c3ca1f9c7a595baf1d46d898/pa/BU15419_4d004c00066e12ee5f0052ee4a2f6e2f.jpg',
                'https://img-pa.auto1.com/img64/03/6403adf8c3ca1f9c7a595baf1d46d898/pa/BU15419_9e0f2d6e73a9d6c7405864689e857f4d.jpg',
                'https://img-pa.auto1.com/img64/03/6403adf8c3ca1f9c7a595baf1d46d898/pa/BU15419_230d834238fb50eca9d95419287db3b4.jpg',
                'https://img-pa.auto1.com/img64/03/6403adf8c3ca1f9c7a595baf1d46d898/pa/BU15419_ee10ad623f29854aec1e3099636cd58c.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c076bccc-b1c9-5648-ba84-ce5655f6a574/c076bccc-b1c9-5648-ba84-ce5655f6a574_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83934,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img64/03/6403adf8c3ca1f9c7a595baf1d46d898/pa/BU15419_2b1645ecf055b1d6451738cecfdceb3b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c076bccc-b1c9-5648-ba84-ce5655f6a574/c076bccc-b1c9-5648-ba84-ce5655f6a574_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3143803,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img64/03/6403adf8c3ca1f9c7a595baf1d46d898/pa/BU15419_4b623bdccbc2ce9a79b174dad078bd56.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c076bccc-b1c9-5648-ba84-ce5655f6a574/c076bccc-b1c9-5648-ba84-ce5655f6a574_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3070762,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img64/03/6403adf8c3ca1f9c7a595baf1d46d898/pa/BU15419_5fdf190c22ead06cb50b78f8a4e4543f.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c076bccc-b1c9-5648-ba84-ce5655f6a574/c076bccc-b1c9-5648-ba84-ce5655f6a574_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2623434,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img64/03/6403adf8c3ca1f9c7a595baf1d46d898/pa/BU15419_598f7ec63d015199697a85584f804e51.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c076bccc-b1c9-5648-ba84-ce5655f6a574/c076bccc-b1c9-5648-ba84-ce5655f6a574_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2971288,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img64/03/6403adf8c3ca1f9c7a595baf1d46d898/pa/BU15419_f170faf71da94ea8de3e5e36ec1adebd.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c076bccc-b1c9-5648-ba84-ce5655f6a574/c076bccc-b1c9-5648-ba84-ce5655f6a574_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81244,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img64/03/6403adf8c3ca1f9c7a595baf1d46d898/pa/BU15419_afa43b65cfe370b996ac82eaa081beff.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c076bccc-b1c9-5648-ba84-ce5655f6a574/c076bccc-b1c9-5648-ba84-ce5655f6a574_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3352644,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img64/03/6403adf8c3ca1f9c7a595baf1d46d898/pa/BU15419_4d004c00066e12ee5f0052ee4a2f6e2f.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c076bccc-b1c9-5648-ba84-ce5655f6a574/c076bccc-b1c9-5648-ba84-ce5655f6a574_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3109058,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img64/03/6403adf8c3ca1f9c7a595baf1d46d898/pa/BU15419_9e0f2d6e73a9d6c7405864689e857f4d.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c076bccc-b1c9-5648-ba84-ce5655f6a574/c076bccc-b1c9-5648-ba84-ce5655f6a574_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3045098,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img64/03/6403adf8c3ca1f9c7a595baf1d46d898/pa/BU15419_230d834238fb50eca9d95419287db3b4.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c076bccc-b1c9-5648-ba84-ce5655f6a574/c076bccc-b1c9-5648-ba84-ce5655f6a574_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2677472,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img64/03/6403adf8c3ca1f9c7a595baf1d46d898/pa/BU15419_ee10ad623f29854aec1e3099636cd58c.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-06-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 3008 1.2 PureTech Allure Business',
 'transmission': 'manual',
 'trim': 'Allure Business',
 'year': 2017}
2026-03-27 12:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BU15419%27 HTTP/1.1" 200 None
2026-03-27 12:10:37 [auto1.nl] INFO: Saving data for BU15419: {'created_time': 1774613437.263285, 'last_price_update_time': 1774613437.263295, 'auction_closing_time': 1774716730.0}
2026-03-27 12:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='BU15419') HTTP/1.1" 204 0
2026-03-27 12:10:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: cd61cbb9-f227-5599-9f83-2942b52c0271 with identifier: TC15988
2026-03-27 12:10:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: cd61cbb9-f227-5599-9f83-2942b52c0271 with identifier: TC15988
2026-03-27 12:10:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: cd61cbb9-f227-5599-9f83-2942b52c0271 with identifier: TC15988 to the API
2026-03-27 12:10:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 12:10:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 12:10:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/TC15988>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.4L',
 'engine_horse_power': 204,
 'expiration_date': '2026-03-28T16:09:41Z',
 'fuel_type': 'hybrid',
 'id': 'cd61cbb9-f227-5599-9f83-2942b52c0271',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'KL989F',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TC15988',
 'listing': 'auction',
 'location': 'NL, Oosterhout',
 'make': 'Audi',
 'model': 'A3 Sportback',
 'odometer': 129745,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 14,
 'photo_urls': ['https://img-pa.auto1.com/img0a/82/0a82ee1313168cc8a05608daf86a9ee3/pa/TC15988_7c6a7c850f19b831f40b33463744c838.jpg',
                'https://img-pa.auto1.com/img0a/82/0a82ee1313168cc8a05608daf86a9ee3/pa/TC15988_43f745ee1519af6a37600cb1bedd8e9c.jpg',
                'https://img-pa.auto1.com/img0a/82/0a82ee1313168cc8a05608daf86a9ee3/pa/TC15988_501d32fdb5affceee31410bf1f982670.jpg',
                'https://img-pa.auto1.com/img0a/82/0a82ee1313168cc8a05608daf86a9ee3/pa/TC15988_6ed3156509f8ec3f114af2eec5fbf8a2.jpg',
                'https://img-pa.auto1.com/img0a/82/0a82ee1313168cc8a05608daf86a9ee3/pa/TC15988_de760d6649e50b9f49c62b51fd9b4b09.jpg',
                'https://img-pa.auto1.com/img0a/82/0a82ee1313168cc8a05608daf86a9ee3/pa/TC15988_8fe819fb66a518193a7b4cc786482e08.jpg',
                'https://img-pa.auto1.com/img0a/82/0a82ee1313168cc8a05608daf86a9ee3/pa/TC15988_dc916da9d0bd8c34ade781d7e5d1f175.jpg',
                'https://img-pa.auto1.com/img0a/82/0a82ee1313168cc8a05608daf86a9ee3/pa/TC15988_6f08c82a80480a5238a464cd6edf2c11.jpg',
                'https://img-pa.auto1.com/img0a/82/0a82ee1313168cc8a05608daf86a9ee3/pa/TC15988_4df32acad7f631951f8f16dbdf4c2d6f.jpg',
                'https://img-pa.auto1.com/img0a/82/0a82ee1313168cc8a05608daf86a9ee3/pa/TC15988_3120569b8eb0e6a48a44645e57fc38dd.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cd61cbb9-f227-5599-9f83-2942b52c0271/cd61cbb9-f227-5599-9f83-2942b52c0271_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 104997,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0a/82/0a82ee1313168cc8a05608daf86a9ee3/pa/TC15988_7c6a7c850f19b831f40b33463744c838.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cd61cbb9-f227-5599-9f83-2942b52c0271/cd61cbb9-f227-5599-9f83-2942b52c0271_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 97820,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0a/82/0a82ee1313168cc8a05608daf86a9ee3/pa/TC15988_43f745ee1519af6a37600cb1bedd8e9c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cd61cbb9-f227-5599-9f83-2942b52c0271/cd61cbb9-f227-5599-9f83-2942b52c0271_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 104472,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0a/82/0a82ee1313168cc8a05608daf86a9ee3/pa/TC15988_501d32fdb5affceee31410bf1f982670.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cd61cbb9-f227-5599-9f83-2942b52c0271/cd61cbb9-f227-5599-9f83-2942b52c0271_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85267,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0a/82/0a82ee1313168cc8a05608daf86a9ee3/pa/TC15988_6ed3156509f8ec3f114af2eec5fbf8a2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cd61cbb9-f227-5599-9f83-2942b52c0271/cd61cbb9-f227-5599-9f83-2942b52c0271_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 103449,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0a/82/0a82ee1313168cc8a05608daf86a9ee3/pa/TC15988_de760d6649e50b9f49c62b51fd9b4b09.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cd61cbb9-f227-5599-9f83-2942b52c0271/cd61cbb9-f227-5599-9f83-2942b52c0271_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84322,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0a/82/0a82ee1313168cc8a05608daf86a9ee3/pa/TC15988_8fe819fb66a518193a7b4cc786482e08.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cd61cbb9-f227-5599-9f83-2942b52c0271/cd61cbb9-f227-5599-9f83-2942b52c0271_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 96845,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0a/82/0a82ee1313168cc8a05608daf86a9ee3/pa/TC15988_dc916da9d0bd8c34ade781d7e5d1f175.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cd61cbb9-f227-5599-9f83-2942b52c0271/cd61cbb9-f227-5599-9f83-2942b52c0271_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 115171,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0a/82/0a82ee1313168cc8a05608daf86a9ee3/pa/TC15988_6f08c82a80480a5238a464cd6edf2c11.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cd61cbb9-f227-5599-9f83-2942b52c0271/cd61cbb9-f227-5599-9f83-2942b52c0271_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 109489,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0a/82/0a82ee1313168cc8a05608daf86a9ee3/pa/TC15988_4df32acad7f631951f8f16dbdf4c2d6f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cd61cbb9-f227-5599-9f83-2942b52c0271/cd61cbb9-f227-5599-9f83-2942b52c0271_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 104153,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0a/82/0a82ee1313168cc8a05608daf86a9ee3/pa/TC15988_3120569b8eb0e6a48a44645e57fc38dd.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2015-11-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi A3 Sportback 1.4 TFSI e-tron S line Sportpaket',
 'transmission': 'automatic',
 'trim': 'S line Sportpaket',
 'year': 2015}
2026-03-27 12:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TC15988%27 HTTP/1.1" 200 None
2026-03-27 12:10:38 [auto1.nl] INFO: Saving data for TC15988: {'created_time': 1774613438.55577, 'last_price_update_time': 1774613438.55578, 'auction_closing_time': 1774714181.0}
2026-03-27 12:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='TC15988') HTTP/1.1" 204 0
2026-03-27 12:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd1%252Fa8%252Fd1a8c3e162d76c7cb16d29605c4f5ea3%252Fpa%252FST70882_47f4b01c4b5119b4e9418e2670037823.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:10:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd1/a8/d1a8c3e162d76c7cb16d29605c4f5ea3/pa/ST70882_47f4b01c4b5119b4e9418e2670037823.jpg not downloaded yet
2026-03-27 12:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252F9d%252F969d1a04c2996f89d3e4f893f4070169%252Fpa%252FFK39304_c201ea8bade707732ea39c9d9153e896.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:10:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/9d/969d1a04c2996f89d3e4f893f4070169/pa/FK39304_c201ea8bade707732ea39c9d9153e896.jpg not downloaded yet
2026-03-27 12:10:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1e/af/1eafd7fe25d766059ffa3f84ac586728/pa/HA14742_3a893b1aa37adc1b2e1fc12b4e52e92a.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:10:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0f/c7/0fc7f4b96d6c761f832997fbab669e9c/pa/SY53039_931c575baed52dc47c74545223a5e8b5.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:10:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PA07201> (referer: https://www.auto1.com/v1/car-details-view/PA07201/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 12:10:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0f/c7/0fc7f4b96d6c761f832997fbab669e9c/pa/SY53039_2596e41c88c0d83fa63003c8bc5842f8.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd1%252Fa8%252Fd1a8c3e162d76c7cb16d29605c4f5ea3%252Fpa%252FST70882_9ff651e084bc8e9c7ba5a82f4bc12f87.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:10:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd1/a8/d1a8c3e162d76c7cb16d29605c4f5ea3/pa/ST70882_9ff651e084bc8e9c7ba5a82f4bc12f87.jpg not downloaded yet
2026-03-27 12:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252F9d%252F969d1a04c2996f89d3e4f893f4070169%252Fpa%252FFK39304_05e734694292b20cc7e64a05ad2c52e6.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:10:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/9d/969d1a04c2996f89d3e4f893f4070169/pa/FK39304_05e734694292b20cc7e64a05ad2c52e6.jpg not downloaded yet
2026-03-27 12:10:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 12:10:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:10:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7cfeec1d10>
2026-03-27 12:10:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:10:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:10:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:10:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7218c6b3-850a-55af-b95d-11797d99af57/7218c6b3-850a-55af-b95d-11797d99af57_image_7.jpg HTTP/1.1" 201 0
2026-03-27 12:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252Faf%252F1eafd7fe25d766059ffa3f84ac586728%252Fpa%252FHA14742_3d1f2a316e08c6c32e291337fc9fd76f.jpg') HTTP/1.1" 204 0
2026-03-27 12:10:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/af/1eafd7fe25d766059ffa3f84ac586728/pa/HA14742_3d1f2a316e08c6c32e291337fc9fd76f.jpg saved to cache
2026-03-27 12:10:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 7218c6b3-850a-55af-b95d-11797d99af57
2026-03-27 12:10:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:10:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7cfcdee150>
2026-03-27 12:10:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:10:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:10:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:10:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7218c6b3-850a-55af-b95d-11797d99af57/7218c6b3-850a-55af-b95d-11797d99af57_image_6.jpg HTTP/1.1" 201 0
2026-03-27 12:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252Faf%252F1eafd7fe25d766059ffa3f84ac586728%252Fpa%252FHA14742_f204816fb677d5bcdd9b0957652b37fb.jpg') HTTP/1.1" 204 0
2026-03-27 12:10:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/af/1eafd7fe25d766059ffa3f84ac586728/pa/HA14742_f204816fb677d5bcdd9b0957652b37fb.jpg saved to cache
2026-03-27 12:10:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 7218c6b3-850a-55af-b95d-11797d99af57
2026-03-27 12:10:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:10:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7cfe1d2ad0>
2026-03-27 12:10:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:10:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:10:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:10:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_02ae6fc4-df0c-537e-bfeb-79779142b37c/02ae6fc4-df0c-537e-bfeb-79779142b37c_image_7.jpg HTTP/1.1" 201 0
2026-03-27 12:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0f%252Fc7%252F0fc7f4b96d6c761f832997fbab669e9c%252Fpa%252FSY53039_a2a33313d92874bad438b0d6a0302234.jpg') HTTP/1.1" 204 0
2026-03-27 12:10:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0f/c7/0fc7f4b96d6c761f832997fbab669e9c/pa/SY53039_a2a33313d92874bad438b0d6a0302234.jpg saved to cache
2026-03-27 12:10:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 02ae6fc4-df0c-537e-bfeb-79779142b37c
2026-03-27 12:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd1%252Fa8%252Fd1a8c3e162d76c7cb16d29605c4f5ea3%252Fpa%252FST70882_9a1fcfef11eea70933db4e1bbe94e096.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:10:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd1/a8/d1a8c3e162d76c7cb16d29605c4f5ea3/pa/ST70882_9a1fcfef11eea70933db4e1bbe94e096.jpg not downloaded yet
2026-03-27 12:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252F9d%252F969d1a04c2996f89d3e4f893f4070169%252Fpa%252FFK39304_95aee116dc4e3182190f2e0b81159531.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:10:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/9d/969d1a04c2996f89d3e4f893f4070169/pa/FK39304_95aee116dc4e3182190f2e0b81159531.jpg not downloaded yet
2026-03-27 12:10:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:10:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7cfdf9ab50>
2026-03-27 12:10:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:10:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:10:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:10:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7218c6b3-850a-55af-b95d-11797d99af57/7218c6b3-850a-55af-b95d-11797d99af57_image_8.jpg HTTP/1.1" 201 0
2026-03-27 12:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252Faf%252F1eafd7fe25d766059ffa3f84ac586728%252Fpa%252FHA14742_3a893b1aa37adc1b2e1fc12b4e52e92a.jpg') HTTP/1.1" 204 0
2026-03-27 12:10:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/af/1eafd7fe25d766059ffa3f84ac586728/pa/HA14742_3a893b1aa37adc1b2e1fc12b4e52e92a.jpg saved to cache
2026-03-27 12:10:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 7218c6b3-850a-55af-b95d-11797d99af57
2026-03-27 12:10:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:10:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7cfdff9510>
2026-03-27 12:10:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:10:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:10:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:10:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_02ae6fc4-df0c-537e-bfeb-79779142b37c/02ae6fc4-df0c-537e-bfeb-79779142b37c_image_6.jpg HTTP/1.1" 201 0
2026-03-27 12:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0f%252Fc7%252F0fc7f4b96d6c761f832997fbab669e9c%252Fpa%252FSY53039_931c575baed52dc47c74545223a5e8b5.jpg') HTTP/1.1" 204 0
2026-03-27 12:10:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0f/c7/0fc7f4b96d6c761f832997fbab669e9c/pa/SY53039_931c575baed52dc47c74545223a5e8b5.jpg saved to cache
2026-03-27 12:10:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 02ae6fc4-df0c-537e-bfeb-79779142b37c
2026-03-27 12:10:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c82a1fc8-55b0-54f1-b687-49855322d40e with identifier: PA07201
2026-03-27 12:10:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c82a1fc8-55b0-54f1-b687-49855322d40e with scrape type 1
2026-03-27 12:10:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 4 photos for item c82a1fc8-55b0-54f1-b687-49855322d40e
2026-03-27 12:10:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga5%252Fb3%252Fa5b3ef4917dacddce86593a87fbf4245%252Fpa%252FPA07201_0354e1fe8b2d60934635019cad3f3dc6.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:10:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/b3/a5b3ef4917dacddce86593a87fbf4245/pa/PA07201_0354e1fe8b2d60934635019cad3f3dc6.jpg not downloaded yet
2026-03-27 12:10:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:10:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7cfe0c86d0>
2026-03-27 12:10:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:10:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:10:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:10:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_02ae6fc4-df0c-537e-bfeb-79779142b37c/02ae6fc4-df0c-537e-bfeb-79779142b37c_image_8.jpg HTTP/1.1" 201 0
2026-03-27 12:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0f%252Fc7%252F0fc7f4b96d6c761f832997fbab669e9c%252Fpa%252FSY53039_2596e41c88c0d83fa63003c8bc5842f8.jpg') HTTP/1.1" 204 0
2026-03-27 12:10:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0f/c7/0fc7f4b96d6c761f832997fbab669e9c/pa/SY53039_2596e41c88c0d83fa63003c8bc5842f8.jpg saved to cache
2026-03-27 12:10:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 02ae6fc4-df0c-537e-bfeb-79779142b37c
2026-03-27 12:10:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0f/c7/0fc7f4b96d6c761f832997fbab669e9c/pa/SY53039_d08462e242ac494ddba2f8dcb360d63e.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:10:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1e/af/1eafd7fe25d766059ffa3f84ac586728/pa/HA14742_8a02d5750f9b44fad725fdc29001c72c.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgd1%252Fa8%252Fd1a8c3e162d76c7cb16d29605c4f5ea3%252Fpa%252FST70882_6d532b901302924f6c0566dd38756f79.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:10:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd1/a8/d1a8c3e162d76c7cb16d29605c4f5ea3/pa/ST70882_6d532b901302924f6c0566dd38756f79.jpg not downloaded yet
2026-03-27 12:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252F9d%252F969d1a04c2996f89d3e4f893f4070169%252Fpa%252FFK39304_fdd281f63e939662829751cfadf43ef3.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:10:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/9d/969d1a04c2996f89d3e4f893f4070169/pa/FK39304_fdd281f63e939662829751cfadf43ef3.jpg not downloaded yet
2026-03-27 12:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga5%252Fb3%252Fa5b3ef4917dacddce86593a87fbf4245%252Fpa%252FPA07201_d564b063c4101d29e50a6c6f818aaf08.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:10:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/b3/a5b3ef4917dacddce86593a87fbf4245/pa/PA07201_d564b063c4101d29e50a6c6f818aaf08.jpg not downloaded yet
2026-03-27 12:10:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0f/c7/0fc7f4b96d6c761f832997fbab669e9c/pa/SY53039_5e20e69232f7d467b35c97b1297af140.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252F9d%252F969d1a04c2996f89d3e4f893f4070169%252Fpa%252FFK39304_4b9a8759e5637cf1a79252970f04cd7c.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:10:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/9d/969d1a04c2996f89d3e4f893f4070169/pa/FK39304_4b9a8759e5637cf1a79252970f04cd7c.jpg not downloaded yet
2026-03-27 12:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga5%252Fb3%252Fa5b3ef4917dacddce86593a87fbf4245%252Fpa%252FPA07201_9c7418ff0e9af41f0692afb28800978a.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:10:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/b3/a5b3ef4917dacddce86593a87fbf4245/pa/PA07201_9c7418ff0e9af41f0692afb28800978a.jpg not downloaded yet
2026-03-27 12:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252F9d%252F969d1a04c2996f89d3e4f893f4070169%252Fpa%252FFK39304_d229e7d84dfd4882526031da66484814.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:10:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/9d/969d1a04c2996f89d3e4f893f4070169/pa/FK39304_d229e7d84dfd4882526031da66484814.jpg not downloaded yet
2026-03-27 12:10:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd1/a8/d1a8c3e162d76c7cb16d29605c4f5ea3/pa/ST70882_47f4b01c4b5119b4e9418e2670037823.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimga5%252Fb3%252Fa5b3ef4917dacddce86593a87fbf4245%252Fpa%252FPA07201_ebdebaa1f1186e5ca39a232a861ae316.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:10:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/b3/a5b3ef4917dacddce86593a87fbf4245/pa/PA07201_ebdebaa1f1186e5ca39a232a861ae316.jpg not downloaded yet
2026-03-27 12:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252F9d%252F969d1a04c2996f89d3e4f893f4070169%252Fpa%252FFK39304_0f7bb0c7fdc9a07f861cf9b9de7f2f8e.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:10:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/9d/969d1a04c2996f89d3e4f893f4070169/pa/FK39304_0f7bb0c7fdc9a07f861cf9b9de7f2f8e.jpg not downloaded yet
2026-03-27 12:10:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img96/9d/969d1a04c2996f89d3e4f893f4070169/pa/FK39304_d348adefa177e88d0d34d9c347edc5a7.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:10:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:10:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7cfdfe1e50>
2026-03-27 12:10:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:10:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:10:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:10:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_02ae6fc4-df0c-537e-bfeb-79779142b37c/02ae6fc4-df0c-537e-bfeb-79779142b37c_image_4.jpg HTTP/1.1" 201 0
2026-03-27 12:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0f%252Fc7%252F0fc7f4b96d6c761f832997fbab669e9c%252Fpa%252FSY53039_d08462e242ac494ddba2f8dcb360d63e.jpg') HTTP/1.1" 204 0
2026-03-27 12:10:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0f/c7/0fc7f4b96d6c761f832997fbab669e9c/pa/SY53039_d08462e242ac494ddba2f8dcb360d63e.jpg saved to cache
2026-03-27 12:10:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 02ae6fc4-df0c-537e-bfeb-79779142b37c
2026-03-27 12:10:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:10:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7cfccfded0>
2026-03-27 12:10:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:10:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:10:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:10:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7218c6b3-850a-55af-b95d-11797d99af57/7218c6b3-850a-55af-b95d-11797d99af57_image_9.jpg HTTP/1.1" 201 0
2026-03-27 12:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252Faf%252F1eafd7fe25d766059ffa3f84ac586728%252Fpa%252FHA14742_8a02d5750f9b44fad725fdc29001c72c.jpg') HTTP/1.1" 204 0
2026-03-27 12:10:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/af/1eafd7fe25d766059ffa3f84ac586728/pa/HA14742_8a02d5750f9b44fad725fdc29001c72c.jpg saved to cache
2026-03-27 12:10:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 7218c6b3-850a-55af-b95d-11797d99af57
2026-03-27 12:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252F9d%252F969d1a04c2996f89d3e4f893f4070169%252Fpa%252FFK39304_14332e445155f40b2313e89ef23a560a.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:10:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/9d/969d1a04c2996f89d3e4f893f4070169/pa/FK39304_14332e445155f40b2313e89ef23a560a.jpg not downloaded yet
2026-03-27 12:10:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:10:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7cfce628d0>
2026-03-27 12:10:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:10:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:10:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:10:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_02ae6fc4-df0c-537e-bfeb-79779142b37c/02ae6fc4-df0c-537e-bfeb-79779142b37c_image_9.jpg HTTP/1.1" 201 0
2026-03-27 12:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0f%252Fc7%252F0fc7f4b96d6c761f832997fbab669e9c%252Fpa%252FSY53039_5e20e69232f7d467b35c97b1297af140.jpg') HTTP/1.1" 204 0
2026-03-27 12:10:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0f/c7/0fc7f4b96d6c761f832997fbab669e9c/pa/SY53039_5e20e69232f7d467b35c97b1297af140.jpg saved to cache
2026-03-27 12:10:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 02ae6fc4-df0c-537e-bfeb-79779142b37c
2026-03-27 12:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252F9d%252F969d1a04c2996f89d3e4f893f4070169%252Fpa%252FFK39304_905f1cddb0eb8e73b799b6c2de0caedb.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:10:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/9d/969d1a04c2996f89d3e4f893f4070169/pa/FK39304_905f1cddb0eb8e73b799b6c2de0caedb.jpg not downloaded yet
2026-03-27 12:10:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NV18219> (referer: https://www.auto1.com/v1/car-details-view/NV18219/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 12:10:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GN83420/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 12:10:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1e/af/1eafd7fe25d766059ffa3f84ac586728/pa/HA14742_cc5405454c585b6f9cb49a9d4514f432.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:10:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1e/af/1eafd7fe25d766059ffa3f84ac586728/pa/HA14742_ca139f98fbca4fc975270c1ac32c88f5.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:10:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd1/a8/d1a8c3e162d76c7cb16d29605c4f5ea3/pa/ST70882_9a1fcfef11eea70933db4e1bbe94e096.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:10:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img96/9d/969d1a04c2996f89d3e4f893f4070169/pa/FK39304_c201ea8bade707732ea39c9d9153e896.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:10:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:10:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7cfdf0f3d0>
2026-03-27 12:10:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:10:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:10:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:10:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e4cf93ee-ae4b-5a94-a142-2495a0f3d548/e4cf93ee-ae4b-5a94-a142-2495a0f3d548_image_1.jpg HTTP/1.1" 201 0
2026-03-27 12:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd1%252Fa8%252Fd1a8c3e162d76c7cb16d29605c4f5ea3%252Fpa%252FST70882_47f4b01c4b5119b4e9418e2670037823.jpg') HTTP/1.1" 204 0
2026-03-27 12:10:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd1/a8/d1a8c3e162d76c7cb16d29605c4f5ea3/pa/ST70882_47f4b01c4b5119b4e9418e2670037823.jpg saved to cache
2026-03-27 12:10:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e4cf93ee-ae4b-5a94-a142-2495a0f3d548
2026-03-27 12:10:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:10:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7cfce60cd0>
2026-03-27 12:10:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:10:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:10:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:10:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aaeb7602-4138-550e-88fa-de8627c49056/aaeb7602-4138-550e-88fa-de8627c49056_image_0.jpg HTTP/1.1" 201 0
2026-03-27 12:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252F9d%252F969d1a04c2996f89d3e4f893f4070169%252Fpa%252FFK39304_d348adefa177e88d0d34d9c347edc5a7.jpg') HTTP/1.1" 204 0
2026-03-27 12:10:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/9d/969d1a04c2996f89d3e4f893f4070169/pa/FK39304_d348adefa177e88d0d34d9c347edc5a7.jpg saved to cache
2026-03-27 12:10:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item aaeb7602-4138-550e-88fa-de8627c49056
2026-03-27 12:10:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1e/af/1eafd7fe25d766059ffa3f84ac586728/pa/HA14742_7aba7bd82321365dbd008d1e623ed69c.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:10:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img96/9d/969d1a04c2996f89d3e4f893f4070169/pa/FK39304_95aee116dc4e3182190f2e0b81159531.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:10:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0f/c7/0fc7f4b96d6c761f832997fbab669e9c/pa/SY53039_c97caf558b04617c8d3851a9c42876c3.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:10:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0f/c7/0fc7f4b96d6c761f832997fbab669e9c/pa/SY53039_2cbf6d4e3f5f9889abd3aa92a1e305b4.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:10:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f2c29d93-16a6-508a-9123-64321ec59c9a with identifier: NV18219
2026-03-27 12:10:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f2c29d93-16a6-508a-9123-64321ec59c9a with scrape type 1
2026-03-27 12:10:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item f2c29d93-16a6-508a-9123-64321ec59c9a
2026-03-27 12:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3b%252F8c%252F3b8c16a541993367e16bc3ec1e30bb94%252Fpa%252FNV18219_4bf969347db9768f34235c6ca2972692.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:10:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3b/8c/3b8c16a541993367e16bc3ec1e30bb94/pa/NV18219_4bf969347db9768f34235c6ca2972692.jpg not downloaded yet
2026-03-27 12:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3b%252F8c%252F3b8c16a541993367e16bc3ec1e30bb94%252Fpa%252FNV18219_7eabbf1da822ae17b3086a0e2a05a79d.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:10:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3b/8c/3b8c16a541993367e16bc3ec1e30bb94/pa/NV18219_7eabbf1da822ae17b3086a0e2a05a79d.jpg not downloaded yet
2026-03-27 12:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3b%252F8c%252F3b8c16a541993367e16bc3ec1e30bb94%252Fpa%252FNV18219_d681239ef1af9ad4ca3fe88b6194bee7.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:10:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3b/8c/3b8c16a541993367e16bc3ec1e30bb94/pa/NV18219_d681239ef1af9ad4ca3fe88b6194bee7.jpg not downloaded yet
2026-03-27 12:10:39 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 12:10:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:10:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7cfcd120d0>
2026-03-27 12:10:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:10:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:10:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:10:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7218c6b3-850a-55af-b95d-11797d99af57/7218c6b3-850a-55af-b95d-11797d99af57_image_0.jpg HTTP/1.1" 201 0
2026-03-27 12:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252Faf%252F1eafd7fe25d766059ffa3f84ac586728%252Fpa%252FHA14742_cc5405454c585b6f9cb49a9d4514f432.jpg') HTTP/1.1" 204 0
2026-03-27 12:10:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/af/1eafd7fe25d766059ffa3f84ac586728/pa/HA14742_cc5405454c585b6f9cb49a9d4514f432.jpg saved to cache
2026-03-27 12:10:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7218c6b3-850a-55af-b95d-11797d99af57
2026-03-27 12:10:39 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 12:10:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:10:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7cfe0e0850>
2026-03-27 12:10:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:10:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:10:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:10:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7218c6b3-850a-55af-b95d-11797d99af57/7218c6b3-850a-55af-b95d-11797d99af57_image_2.jpg HTTP/1.1" 201 0
2026-03-27 12:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252Faf%252F1eafd7fe25d766059ffa3f84ac586728%252Fpa%252FHA14742_ca139f98fbca4fc975270c1ac32c88f5.jpg') HTTP/1.1" 204 0
2026-03-27 12:10:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/af/1eafd7fe25d766059ffa3f84ac586728/pa/HA14742_ca139f98fbca4fc975270c1ac32c88f5.jpg saved to cache
2026-03-27 12:10:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 7218c6b3-850a-55af-b95d-11797d99af57
2026-03-27 12:10:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:10:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7cfcca4350>
2026-03-27 12:10:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:10:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:10:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:10:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e4cf93ee-ae4b-5a94-a142-2495a0f3d548/e4cf93ee-ae4b-5a94-a142-2495a0f3d548_image_3.jpg HTTP/1.1" 201 0
2026-03-27 12:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd1%252Fa8%252Fd1a8c3e162d76c7cb16d29605c4f5ea3%252Fpa%252FST70882_9a1fcfef11eea70933db4e1bbe94e096.jpg') HTTP/1.1" 204 0
2026-03-27 12:10:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd1/a8/d1a8c3e162d76c7cb16d29605c4f5ea3/pa/ST70882_9a1fcfef11eea70933db4e1bbe94e096.jpg saved to cache
2026-03-27 12:10:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e4cf93ee-ae4b-5a94-a142-2495a0f3d548
2026-03-27 12:10:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:10:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7cfe252fd0>
2026-03-27 12:10:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:10:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:10:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:10:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aaeb7602-4138-550e-88fa-de8627c49056/aaeb7602-4138-550e-88fa-de8627c49056_image_1.jpg HTTP/1.1" 201 0
2026-03-27 12:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252F9d%252F969d1a04c2996f89d3e4f893f4070169%252Fpa%252FFK39304_c201ea8bade707732ea39c9d9153e896.jpg') HTTP/1.1" 204 0
2026-03-27 12:10:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/9d/969d1a04c2996f89d3e4f893f4070169/pa/FK39304_c201ea8bade707732ea39c9d9153e896.jpg saved to cache
2026-03-27 12:10:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item aaeb7602-4138-550e-88fa-de8627c49056
2026-03-27 12:10:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga5/b3/a5b3ef4917dacddce86593a87fbf4245/pa/PA07201_9c7418ff0e9af41f0692afb28800978a.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3b%252F8c%252F3b8c16a541993367e16bc3ec1e30bb94%252Fpa%252FNV18219_96c6bb34ef61bd8d2d992e975275e10c.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:10:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3b/8c/3b8c16a541993367e16bc3ec1e30bb94/pa/NV18219_96c6bb34ef61bd8d2d992e975275e10c.jpg not downloaded yet
2026-03-27 12:10:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga5/b3/a5b3ef4917dacddce86593a87fbf4245/pa/PA07201_ebdebaa1f1186e5ca39a232a861ae316.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:10:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img96/9d/969d1a04c2996f89d3e4f893f4070169/pa/FK39304_0f7bb0c7fdc9a07f861cf9b9de7f2f8e.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:10:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img96/9d/969d1a04c2996f89d3e4f893f4070169/pa/FK39304_905f1cddb0eb8e73b799b6c2de0caedb.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg3b%252F8c%252F3b8c16a541993367e16bc3ec1e30bb94%252Fpa%252FNV18219_be5a4b71e62d7468c4e979be416625c6.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:10:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3b/8c/3b8c16a541993367e16bc3ec1e30bb94/pa/NV18219_be5a4b71e62d7468c4e979be416625c6.jpg not downloaded yet
2026-03-27 12:10:39 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 12:10:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:10:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7cfdf15f50>
2026-03-27 12:10:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:10:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:10:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:10:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7218c6b3-850a-55af-b95d-11797d99af57/7218c6b3-850a-55af-b95d-11797d99af57_image_4.jpg HTTP/1.1" 201 0
2026-03-27 12:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252Faf%252F1eafd7fe25d766059ffa3f84ac586728%252Fpa%252FHA14742_7aba7bd82321365dbd008d1e623ed69c.jpg') HTTP/1.1" 204 0
2026-03-27 12:10:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/af/1eafd7fe25d766059ffa3f84ac586728/pa/HA14742_7aba7bd82321365dbd008d1e623ed69c.jpg saved to cache
2026-03-27 12:10:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 7218c6b3-850a-55af-b95d-11797d99af57
2026-03-27 12:10:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:10:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7cfe1593d0>
2026-03-27 12:10:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:10:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:10:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:10:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aaeb7602-4138-550e-88fa-de8627c49056/aaeb7602-4138-550e-88fa-de8627c49056_image_3.jpg HTTP/1.1" 201 0
2026-03-27 12:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252F9d%252F969d1a04c2996f89d3e4f893f4070169%252Fpa%252FFK39304_95aee116dc4e3182190f2e0b81159531.jpg') HTTP/1.1" 204 0
2026-03-27 12:10:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/9d/969d1a04c2996f89d3e4f893f4070169/pa/FK39304_95aee116dc4e3182190f2e0b81159531.jpg saved to cache
2026-03-27 12:10:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item aaeb7602-4138-550e-88fa-de8627c49056
2026-03-27 12:10:40 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 12:10:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:10:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7cfdffb350>
2026-03-27 12:10:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:10:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:10:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:10:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_02ae6fc4-df0c-537e-bfeb-79779142b37c/02ae6fc4-df0c-537e-bfeb-79779142b37c_image_0.jpg HTTP/1.1" 201 0
2026-03-27 12:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0f%252Fc7%252F0fc7f4b96d6c761f832997fbab669e9c%252Fpa%252FSY53039_c97caf558b04617c8d3851a9c42876c3.jpg') HTTP/1.1" 204 0
2026-03-27 12:10:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0f/c7/0fc7f4b96d6c761f832997fbab669e9c/pa/SY53039_c97caf558b04617c8d3851a9c42876c3.jpg saved to cache
2026-03-27 12:10:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 02ae6fc4-df0c-537e-bfeb-79779142b37c
2026-03-27 12:10:40 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 12:10:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:10:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7cfe15a410>
2026-03-27 12:10:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:10:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:10:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:10:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_02ae6fc4-df0c-537e-bfeb-79779142b37c/02ae6fc4-df0c-537e-bfeb-79779142b37c_image_5.jpg HTTP/1.1" 201 0
2026-03-27 12:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0f%252Fc7%252F0fc7f4b96d6c761f832997fbab669e9c%252Fpa%252FSY53039_2cbf6d4e3f5f9889abd3aa92a1e305b4.jpg') HTTP/1.1" 204 0
2026-03-27 12:10:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0f/c7/0fc7f4b96d6c761f832997fbab669e9c/pa/SY53039_2cbf6d4e3f5f9889abd3aa92a1e305b4.jpg saved to cache
2026-03-27 12:10:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 02ae6fc4-df0c-537e-bfeb-79779142b37c
2026-03-27 12:10:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga5/b3/a5b3ef4917dacddce86593a87fbf4245/pa/PA07201_d564b063c4101d29e50a6c6f818aaf08.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:10:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BW44039> (referer: https://www.auto1.com/v1/car-details-view/BW44039/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 12:10:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 12:10:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:10:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7cfcdfe650>
2026-03-27 12:10:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:10:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:10:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:10:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c82a1fc8-55b0-54f1-b687-49855322d40e/c82a1fc8-55b0-54f1-b687-49855322d40e_image_2.jpg HTTP/1.1" 201 0
2026-03-27 12:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga5%252Fb3%252Fa5b3ef4917dacddce86593a87fbf4245%252Fpa%252FPA07201_9c7418ff0e9af41f0692afb28800978a.jpg') HTTP/1.1" 204 0
2026-03-27 12:10:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/b3/a5b3ef4917dacddce86593a87fbf4245/pa/PA07201_9c7418ff0e9af41f0692afb28800978a.jpg saved to cache
2026-03-27 12:10:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c82a1fc8-55b0-54f1-b687-49855322d40e
2026-03-27 12:10:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:10:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7cfcce3450>
2026-03-27 12:10:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:10:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:10:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:10:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c82a1fc8-55b0-54f1-b687-49855322d40e/c82a1fc8-55b0-54f1-b687-49855322d40e_image_3.jpg HTTP/1.1" 201 0
2026-03-27 12:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga5%252Fb3%252Fa5b3ef4917dacddce86593a87fbf4245%252Fpa%252FPA07201_ebdebaa1f1186e5ca39a232a861ae316.jpg') HTTP/1.1" 204 0
2026-03-27 12:10:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/b3/a5b3ef4917dacddce86593a87fbf4245/pa/PA07201_ebdebaa1f1186e5ca39a232a861ae316.jpg saved to cache
2026-03-27 12:10:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c82a1fc8-55b0-54f1-b687-49855322d40e
2026-03-27 12:10:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:10:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7cfdeed290>
2026-03-27 12:10:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:10:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:10:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:10:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aaeb7602-4138-550e-88fa-de8627c49056/aaeb7602-4138-550e-88fa-de8627c49056_image_7.jpg HTTP/1.1" 201 0
2026-03-27 12:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252F9d%252F969d1a04c2996f89d3e4f893f4070169%252Fpa%252FFK39304_0f7bb0c7fdc9a07f861cf9b9de7f2f8e.jpg') HTTP/1.1" 204 0
2026-03-27 12:10:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/9d/969d1a04c2996f89d3e4f893f4070169/pa/FK39304_0f7bb0c7fdc9a07f861cf9b9de7f2f8e.jpg saved to cache
2026-03-27 12:10:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item aaeb7602-4138-550e-88fa-de8627c49056
2026-03-27 12:10:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:10:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7cfcce1f10>
2026-03-27 12:10:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:10:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:10:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:10:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aaeb7602-4138-550e-88fa-de8627c49056/aaeb7602-4138-550e-88fa-de8627c49056_image_9.jpg HTTP/1.1" 201 0
2026-03-27 12:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252F9d%252F969d1a04c2996f89d3e4f893f4070169%252Fpa%252FFK39304_905f1cddb0eb8e73b799b6c2de0caedb.jpg') HTTP/1.1" 204 0
2026-03-27 12:10:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/9d/969d1a04c2996f89d3e4f893f4070169/pa/FK39304_905f1cddb0eb8e73b799b6c2de0caedb.jpg saved to cache
2026-03-27 12:10:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item aaeb7602-4138-550e-88fa-de8627c49056
2026-03-27 12:10:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:10:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7cfe269990>
2026-03-27 12:10:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:10:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:10:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:10:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c82a1fc8-55b0-54f1-b687-49855322d40e/c82a1fc8-55b0-54f1-b687-49855322d40e_image_1.jpg HTTP/1.1" 201 0
2026-03-27 12:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga5%252Fb3%252Fa5b3ef4917dacddce86593a87fbf4245%252Fpa%252FPA07201_d564b063c4101d29e50a6c6f818aaf08.jpg') HTTP/1.1" 204 0
2026-03-27 12:10:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/b3/a5b3ef4917dacddce86593a87fbf4245/pa/PA07201_d564b063c4101d29e50a6c6f818aaf08.jpg saved to cache
2026-03-27 12:10:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c82a1fc8-55b0-54f1-b687-49855322d40e
2026-03-27 12:10:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3617601c-acda-5ab6-882a-3a2097aee563 with identifier: BW44039
2026-03-27 12:10:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3617601c-acda-5ab6-882a-3a2097aee563 with scrape type 1
2026-03-27 12:10:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 3617601c-acda-5ab6-882a-3a2097aee563
2026-03-27 12:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg35%252F08%252F350877352a435debbc9027ae6f36aad6%252Fpa%252FBW44039_2524c38d062b54908b62887f2517524f.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:10:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/08/350877352a435debbc9027ae6f36aad6/pa/BW44039_2524c38d062b54908b62887f2517524f.jpg already downloaded
2026-03-27 12:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg35%252F08%252F350877352a435debbc9027ae6f36aad6%252Fpa%252FBW44039_9e787034bada9b9bfbcb667de8f2c408.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:10:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/08/350877352a435debbc9027ae6f36aad6/pa/BW44039_9e787034bada9b9bfbcb667de8f2c408.jpg already downloaded
2026-03-27 12:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg35%252F08%252F350877352a435debbc9027ae6f36aad6%252Fpa%252FBW44039_c3b63fc22c4704093e8cfbf6bbe8002b.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:10:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/08/350877352a435debbc9027ae6f36aad6/pa/BW44039_c3b63fc22c4704093e8cfbf6bbe8002b.jpg already downloaded
2026-03-27 12:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg35%252F08%252F350877352a435debbc9027ae6f36aad6%252Fpa%252FBW44039_fdb280e4b09379389c9a523547e1fe54.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:10:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/08/350877352a435debbc9027ae6f36aad6/pa/BW44039_fdb280e4b09379389c9a523547e1fe54.jpg already downloaded
2026-03-27 12:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg35%252F08%252F350877352a435debbc9027ae6f36aad6%252Fpa%252FBW44039_63545de85ffa80cd772f2a6ee46bb39d.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:10:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/08/350877352a435debbc9027ae6f36aad6/pa/BW44039_63545de85ffa80cd772f2a6ee46bb39d.jpg already downloaded
2026-03-27 12:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg35%252F08%252F350877352a435debbc9027ae6f36aad6%252Fpa%252FBW44039_9934e4a98f2fb4981a6a7fdd92a17003.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:10:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/08/350877352a435debbc9027ae6f36aad6/pa/BW44039_9934e4a98f2fb4981a6a7fdd92a17003.jpg already downloaded
2026-03-27 12:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg35%252F08%252F350877352a435debbc9027ae6f36aad6%252Fpa%252FBW44039_00033c211778ffc6bc921e44695c6113.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:10:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/08/350877352a435debbc9027ae6f36aad6/pa/BW44039_00033c211778ffc6bc921e44695c6113.jpg already downloaded
2026-03-27 12:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg35%252F08%252F350877352a435debbc9027ae6f36aad6%252Fpa%252FBW44039_d369f5b82f4675d1dd399dcdfe079a10.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:10:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/08/350877352a435debbc9027ae6f36aad6/pa/BW44039_d369f5b82f4675d1dd399dcdfe079a10.jpg already downloaded
2026-03-27 12:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg35%252F08%252F350877352a435debbc9027ae6f36aad6%252Fpa%252FBW44039_0b54a774e567a3d04a371c6a4616d692.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:10:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/08/350877352a435debbc9027ae6f36aad6/pa/BW44039_0b54a774e567a3d04a371c6a4616d692.jpg already downloaded
2026-03-27 12:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg35%252F08%252F350877352a435debbc9027ae6f36aad6%252Fpa%252FBW44039_88ff7ffa63ee76c8c5e35ddc397bf4b7.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:10:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img35/08/350877352a435debbc9027ae6f36aad6/pa/BW44039_88ff7ffa63ee76c8c5e35ddc397bf4b7.jpg already downloaded
2026-03-27 12:10:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 3617601c-acda-5ab6-882a-3a2097aee563, identifier: BW44039
2026-03-27 12:10:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 3617601c-acda-5ab6-882a-3a2097aee563 with identifier: BW44039
2026-03-27 12:10:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 3617601c-acda-5ab6-882a-3a2097aee563 with identifier: BW44039
2026-03-27 12:10:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 3617601c-acda-5ab6-882a-3a2097aee563 with identifier: BW44039 to the API
2026-03-27 12:10:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 12:10:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 12:10:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/BW44039>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 320,
 'expiration_date': '2026-03-28T16:16:47Z',
 'fuel_type': 'hybrid',
 'id': '3617601c-acda-5ab6-882a-3a2097aee563',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'P381VS',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BW44039',
 'listing': 'auction',
 'location': 'NL, Oosterhout',
 'make': 'Mercedes-Benz',
 'model': 'GLC-Klasse',
 'odometer': 152250,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img35/08/350877352a435debbc9027ae6f36aad6/pa/BW44039_2524c38d062b54908b62887f2517524f.jpg',
                'https://img-pa.auto1.com/img35/08/350877352a435debbc9027ae6f36aad6/pa/BW44039_9e787034bada9b9bfbcb667de8f2c408.jpg',
                'https://img-pa.auto1.com/img35/08/350877352a435debbc9027ae6f36aad6/pa/BW44039_c3b63fc22c4704093e8cfbf6bbe8002b.jpg',
                'https://img-pa.auto1.com/img35/08/350877352a435debbc9027ae6f36aad6/pa/BW44039_fdb280e4b09379389c9a523547e1fe54.jpg',
                'https://img-pa.auto1.com/img35/08/350877352a435debbc9027ae6f36aad6/pa/BW44039_63545de85ffa80cd772f2a6ee46bb39d.jpg',
                'https://img-pa.auto1.com/img35/08/350877352a435debbc9027ae6f36aad6/pa/BW44039_9934e4a98f2fb4981a6a7fdd92a17003.jpg',
                'https://img-pa.auto1.com/img35/08/350877352a435debbc9027ae6f36aad6/pa/BW44039_00033c211778ffc6bc921e44695c6113.jpg',
                'https://img-pa.auto1.com/img35/08/350877352a435debbc9027ae6f36aad6/pa/BW44039_d369f5b82f4675d1dd399dcdfe079a10.jpg',
                'https://img-pa.auto1.com/img35/08/350877352a435debbc9027ae6f36aad6/pa/BW44039_0b54a774e567a3d04a371c6a4616d692.jpg',
                'https://img-pa.auto1.com/img35/08/350877352a435debbc9027ae6f36aad6/pa/BW44039_88ff7ffa63ee76c8c5e35ddc397bf4b7.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3617601c-acda-5ab6-882a-3a2097aee563/3617601c-acda-5ab6-882a-3a2097aee563_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74902,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img35/08/350877352a435debbc9027ae6f36aad6/pa/BW44039_2524c38d062b54908b62887f2517524f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3617601c-acda-5ab6-882a-3a2097aee563/3617601c-acda-5ab6-882a-3a2097aee563_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70530,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img35/08/350877352a435debbc9027ae6f36aad6/pa/BW44039_9e787034bada9b9bfbcb667de8f2c408.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3617601c-acda-5ab6-882a-3a2097aee563/3617601c-acda-5ab6-882a-3a2097aee563_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75736,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img35/08/350877352a435debbc9027ae6f36aad6/pa/BW44039_c3b63fc22c4704093e8cfbf6bbe8002b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3617601c-acda-5ab6-882a-3a2097aee563/3617601c-acda-5ab6-882a-3a2097aee563_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67116,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img35/08/350877352a435debbc9027ae6f36aad6/pa/BW44039_fdb280e4b09379389c9a523547e1fe54.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3617601c-acda-5ab6-882a-3a2097aee563/3617601c-acda-5ab6-882a-3a2097aee563_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68924,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img35/08/350877352a435debbc9027ae6f36aad6/pa/BW44039_63545de85ffa80cd772f2a6ee46bb39d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3617601c-acda-5ab6-882a-3a2097aee563/3617601c-acda-5ab6-882a-3a2097aee563_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76323,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img35/08/350877352a435debbc9027ae6f36aad6/pa/BW44039_9934e4a98f2fb4981a6a7fdd92a17003.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3617601c-acda-5ab6-882a-3a2097aee563/3617601c-acda-5ab6-882a-3a2097aee563_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73294,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img35/08/350877352a435debbc9027ae6f36aad6/pa/BW44039_00033c211778ffc6bc921e44695c6113.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3617601c-acda-5ab6-882a-3a2097aee563/3617601c-acda-5ab6-882a-3a2097aee563_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71284,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img35/08/350877352a435debbc9027ae6f36aad6/pa/BW44039_d369f5b82f4675d1dd399dcdfe079a10.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3617601c-acda-5ab6-882a-3a2097aee563/3617601c-acda-5ab6-882a-3a2097aee563_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73513,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img35/08/350877352a435debbc9027ae6f36aad6/pa/BW44039_0b54a774e567a3d04a371c6a4616d692.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3617601c-acda-5ab6-882a-3a2097aee563/3617601c-acda-5ab6-882a-3a2097aee563_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70536,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img35/08/350877352a435debbc9027ae6f36aad6/pa/BW44039_88ff7ffa63ee76c8c5e35ddc397bf4b7.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2022-06-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mercedes-Benz GLC-Klasse GLC 300e 4Matic AMG Line',
 'transmission': 'automatic',
 'trim': '4Matic AMG Line',
 'year': 2022}
2026-03-27 12:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BW44039%27 HTTP/1.1" 200 None
2026-03-27 12:10:41 [auto1.nl] INFO: Saving data for BW44039: {'created_time': 1774613441.406467, 'last_price_update_time': 1774613441.406477, 'auction_closing_time': 1774714607.0}
2026-03-27 12:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='BW44039') HTTP/1.1" 204 0
2026-03-27 12:10:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3b/8c/3b8c16a541993367e16bc3ec1e30bb94/pa/NV18219_7eabbf1da822ae17b3086a0e2a05a79d.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:10:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3b/8c/3b8c16a541993367e16bc3ec1e30bb94/pa/NV18219_be5a4b71e62d7468c4e979be416625c6.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:10:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3b/8c/3b8c16a541993367e16bc3ec1e30bb94/pa/NV18219_96c6bb34ef61bd8d2d992e975275e10c.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:10:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3b/8c/3b8c16a541993367e16bc3ec1e30bb94/pa/NV18219_d681239ef1af9ad4ca3fe88b6194bee7.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:10:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img96/9d/969d1a04c2996f89d3e4f893f4070169/pa/FK39304_4b9a8759e5637cf1a79252970f04cd7c.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:10:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img96/9d/969d1a04c2996f89d3e4f893f4070169/pa/FK39304_fdd281f63e939662829751cfadf43ef3.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:10:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img96/9d/969d1a04c2996f89d3e4f893f4070169/pa/FK39304_d229e7d84dfd4882526031da66484814.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:10:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img96/9d/969d1a04c2996f89d3e4f893f4070169/pa/FK39304_14332e445155f40b2313e89ef23a560a.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:10:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd1/a8/d1a8c3e162d76c7cb16d29605c4f5ea3/pa/ST70882_6d532b901302924f6c0566dd38756f79.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:10:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd1/a8/d1a8c3e162d76c7cb16d29605c4f5ea3/pa/ST70882_9ff651e084bc8e9c7ba5a82f4bc12f87.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:10:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgd1/a8/d1a8c3e162d76c7cb16d29605c4f5ea3/pa/ST70882_7d746e14799ae52f6cc2f208e616678a.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:10:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img3b/8c/3b8c16a541993367e16bc3ec1e30bb94/pa/NV18219_4bf969347db9768f34235c6ca2972692.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:10:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:10:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7cfe20ac10>
2026-03-27 12:10:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:10:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:10:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:10:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f2c29d93-16a6-508a-9123-64321ec59c9a/f2c29d93-16a6-508a-9123-64321ec59c9a_image_1.jpg HTTP/1.1" 201 0
2026-03-27 12:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3b%252F8c%252F3b8c16a541993367e16bc3ec1e30bb94%252Fpa%252FNV18219_7eabbf1da822ae17b3086a0e2a05a79d.jpg') HTTP/1.1" 204 0
2026-03-27 12:10:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3b/8c/3b8c16a541993367e16bc3ec1e30bb94/pa/NV18219_7eabbf1da822ae17b3086a0e2a05a79d.jpg saved to cache
2026-03-27 12:10:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f2c29d93-16a6-508a-9123-64321ec59c9a
2026-03-27 12:10:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:10:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7cfce18e50>
2026-03-27 12:10:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:10:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:10:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:10:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f2c29d93-16a6-508a-9123-64321ec59c9a/f2c29d93-16a6-508a-9123-64321ec59c9a_image_4.jpg HTTP/1.1" 201 0
2026-03-27 12:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3b%252F8c%252F3b8c16a541993367e16bc3ec1e30bb94%252Fpa%252FNV18219_be5a4b71e62d7468c4e979be416625c6.jpg') HTTP/1.1" 204 0
2026-03-27 12:10:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3b/8c/3b8c16a541993367e16bc3ec1e30bb94/pa/NV18219_be5a4b71e62d7468c4e979be416625c6.jpg saved to cache
2026-03-27 12:10:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f2c29d93-16a6-508a-9123-64321ec59c9a
2026-03-27 12:10:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:10:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7cfccf3910>
2026-03-27 12:10:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:10:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:10:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:10:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f2c29d93-16a6-508a-9123-64321ec59c9a/f2c29d93-16a6-508a-9123-64321ec59c9a_image_3.jpg HTTP/1.1" 201 0
2026-03-27 12:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3b%252F8c%252F3b8c16a541993367e16bc3ec1e30bb94%252Fpa%252FNV18219_96c6bb34ef61bd8d2d992e975275e10c.jpg') HTTP/1.1" 204 0
2026-03-27 12:10:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3b/8c/3b8c16a541993367e16bc3ec1e30bb94/pa/NV18219_96c6bb34ef61bd8d2d992e975275e10c.jpg saved to cache
2026-03-27 12:10:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f2c29d93-16a6-508a-9123-64321ec59c9a
2026-03-27 12:10:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:10:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7cfdecd9d0>
2026-03-27 12:10:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:10:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:10:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:10:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f2c29d93-16a6-508a-9123-64321ec59c9a/f2c29d93-16a6-508a-9123-64321ec59c9a_image_2.jpg HTTP/1.1" 201 0
2026-03-27 12:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3b%252F8c%252F3b8c16a541993367e16bc3ec1e30bb94%252Fpa%252FNV18219_d681239ef1af9ad4ca3fe88b6194bee7.jpg') HTTP/1.1" 204 0
2026-03-27 12:10:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3b/8c/3b8c16a541993367e16bc3ec1e30bb94/pa/NV18219_d681239ef1af9ad4ca3fe88b6194bee7.jpg saved to cache
2026-03-27 12:10:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f2c29d93-16a6-508a-9123-64321ec59c9a
2026-03-27 12:10:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0f/c7/0fc7f4b96d6c761f832997fbab669e9c/pa/SY53039_a1d4704d3b1d573cd736e156dc307656.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:10:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img96/9d/969d1a04c2996f89d3e4f893f4070169/pa/FK39304_05e734694292b20cc7e64a05ad2c52e6.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:10:41 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 12:10:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:10:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7cfe25f710>
2026-03-27 12:10:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:10:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:10:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:10:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aaeb7602-4138-550e-88fa-de8627c49056/aaeb7602-4138-550e-88fa-de8627c49056_image_5.jpg HTTP/1.1" 201 0
2026-03-27 12:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252F9d%252F969d1a04c2996f89d3e4f893f4070169%252Fpa%252FFK39304_4b9a8759e5637cf1a79252970f04cd7c.jpg') HTTP/1.1" 204 0
2026-03-27 12:10:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/9d/969d1a04c2996f89d3e4f893f4070169/pa/FK39304_4b9a8759e5637cf1a79252970f04cd7c.jpg saved to cache
2026-03-27 12:10:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item aaeb7602-4138-550e-88fa-de8627c49056
2026-03-27 12:10:41 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 12:10:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:10:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7cfcce20d0>
2026-03-27 12:10:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:10:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:10:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:10:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aaeb7602-4138-550e-88fa-de8627c49056/aaeb7602-4138-550e-88fa-de8627c49056_image_4.jpg HTTP/1.1" 201 0
2026-03-27 12:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252F9d%252F969d1a04c2996f89d3e4f893f4070169%252Fpa%252FFK39304_fdd281f63e939662829751cfadf43ef3.jpg') HTTP/1.1" 204 0
2026-03-27 12:10:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/9d/969d1a04c2996f89d3e4f893f4070169/pa/FK39304_fdd281f63e939662829751cfadf43ef3.jpg saved to cache
2026-03-27 12:10:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item aaeb7602-4138-550e-88fa-de8627c49056
2026-03-27 12:10:41 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 12:10:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:10:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7cfe097f90>
2026-03-27 12:10:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:10:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:10:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:10:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aaeb7602-4138-550e-88fa-de8627c49056/aaeb7602-4138-550e-88fa-de8627c49056_image_6.jpg HTTP/1.1" 201 0
2026-03-27 12:10:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252F9d%252F969d1a04c2996f89d3e4f893f4070169%252Fpa%252FFK39304_d229e7d84dfd4882526031da66484814.jpg') HTTP/1.1" 204 0
2026-03-27 12:10:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/9d/969d1a04c2996f89d3e4f893f4070169/pa/FK39304_d229e7d84dfd4882526031da66484814.jpg saved to cache
2026-03-27 12:10:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item aaeb7602-4138-550e-88fa-de8627c49056
2026-03-27 12:10:42 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 12:10:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:10:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7cfcce3c90>
2026-03-27 12:10:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:10:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:10:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:10:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aaeb7602-4138-550e-88fa-de8627c49056/aaeb7602-4138-550e-88fa-de8627c49056_image_8.jpg HTTP/1.1" 201 0
2026-03-27 12:10:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252F9d%252F969d1a04c2996f89d3e4f893f4070169%252Fpa%252FFK39304_14332e445155f40b2313e89ef23a560a.jpg') HTTP/1.1" 204 0
2026-03-27 12:10:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/9d/969d1a04c2996f89d3e4f893f4070169/pa/FK39304_14332e445155f40b2313e89ef23a560a.jpg saved to cache
2026-03-27 12:10:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item aaeb7602-4138-550e-88fa-de8627c49056
2026-03-27 12:10:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:10:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7cfce18510>
2026-03-27 12:10:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:10:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:10:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:10:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e4cf93ee-ae4b-5a94-a142-2495a0f3d548/e4cf93ee-ae4b-5a94-a142-2495a0f3d548_image_4.jpg HTTP/1.1" 201 0
2026-03-27 12:10:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd1%252Fa8%252Fd1a8c3e162d76c7cb16d29605c4f5ea3%252Fpa%252FST70882_6d532b901302924f6c0566dd38756f79.jpg') HTTP/1.1" 204 0
2026-03-27 12:10:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd1/a8/d1a8c3e162d76c7cb16d29605c4f5ea3/pa/ST70882_6d532b901302924f6c0566dd38756f79.jpg saved to cache
2026-03-27 12:10:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e4cf93ee-ae4b-5a94-a142-2495a0f3d548
2026-03-27 12:10:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:10:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7cfcdf31d0>
2026-03-27 12:10:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:10:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:10:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:10:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e4cf93ee-ae4b-5a94-a142-2495a0f3d548/e4cf93ee-ae4b-5a94-a142-2495a0f3d548_image_2.jpg HTTP/1.1" 201 0
2026-03-27 12:10:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd1%252Fa8%252Fd1a8c3e162d76c7cb16d29605c4f5ea3%252Fpa%252FST70882_9ff651e084bc8e9c7ba5a82f4bc12f87.jpg') HTTP/1.1" 204 0
2026-03-27 12:10:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd1/a8/d1a8c3e162d76c7cb16d29605c4f5ea3/pa/ST70882_9ff651e084bc8e9c7ba5a82f4bc12f87.jpg saved to cache
2026-03-27 12:10:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e4cf93ee-ae4b-5a94-a142-2495a0f3d548
2026-03-27 12:10:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:10:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7cfcdfc8d0>
2026-03-27 12:10:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:10:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:10:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:10:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e4cf93ee-ae4b-5a94-a142-2495a0f3d548/e4cf93ee-ae4b-5a94-a142-2495a0f3d548_image_0.jpg HTTP/1.1" 201 0
2026-03-27 12:10:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgd1%252Fa8%252Fd1a8c3e162d76c7cb16d29605c4f5ea3%252Fpa%252FST70882_7d746e14799ae52f6cc2f208e616678a.jpg') HTTP/1.1" 204 0
2026-03-27 12:10:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgd1/a8/d1a8c3e162d76c7cb16d29605c4f5ea3/pa/ST70882_7d746e14799ae52f6cc2f208e616678a.jpg saved to cache
2026-03-27 12:10:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e4cf93ee-ae4b-5a94-a142-2495a0f3d548
2026-03-27 12:10:42 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e4cf93ee-ae4b-5a94-a142-2495a0f3d548, skipping ID generation
2026-03-27 12:10:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e4cf93ee-ae4b-5a94-a142-2495a0f3d548 with scrape type 1
2026-03-27 12:10:42 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e4cf93ee-ae4b-5a94-a142-2495a0f3d548 sending to next pipeline
2026-03-27 12:10:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: e4cf93ee-ae4b-5a94-a142-2495a0f3d548, identifier: ST70882
2026-03-27 12:10:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:10:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7cfeedc510>
2026-03-27 12:10:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:10:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:10:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:10:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f2c29d93-16a6-508a-9123-64321ec59c9a/f2c29d93-16a6-508a-9123-64321ec59c9a_image_0.jpg HTTP/1.1" 201 0
2026-03-27 12:10:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg3b%252F8c%252F3b8c16a541993367e16bc3ec1e30bb94%252Fpa%252FNV18219_4bf969347db9768f34235c6ca2972692.jpg') HTTP/1.1" 204 0
2026-03-27 12:10:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img3b/8c/3b8c16a541993367e16bc3ec1e30bb94/pa/NV18219_4bf969347db9768f34235c6ca2972692.jpg saved to cache
2026-03-27 12:10:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f2c29d93-16a6-508a-9123-64321ec59c9a
2026-03-27 12:10:42 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f2c29d93-16a6-508a-9123-64321ec59c9a, skipping ID generation
2026-03-27 12:10:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f2c29d93-16a6-508a-9123-64321ec59c9a with scrape type 1
2026-03-27 12:10:42 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f2c29d93-16a6-508a-9123-64321ec59c9a sending to next pipeline
2026-03-27 12:10:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: f2c29d93-16a6-508a-9123-64321ec59c9a, identifier: NV18219
2026-03-27 12:10:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: e4cf93ee-ae4b-5a94-a142-2495a0f3d548 with identifier: ST70882
2026-03-27 12:10:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-27 12:10:42 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=violet HTTP/1.1" 200 None
2026-03-27 12:10:42 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 12:10:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-27 12:10:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: e4cf93ee-ae4b-5a94-a142-2495a0f3d548 with identifier: ST70882
2026-03-27 12:10:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: e4cf93ee-ae4b-5a94-a142-2495a0f3d548 with identifier: ST70882 to the API
2026-03-27 12:10:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 12:10:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 12:10:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgd1/a8/d1a8c3e162d76c7cb16d29605c4f5ea3/pa/ST70882_7d746e14799ae52f6cc2f208e616678a.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 166,
 'category': None,
 'color': 'violet',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 2',
 'engine': '1.1L',
 'engine_horse_power': 58,
 'expiration_date': '2026-03-28T16:07:36Z',
 'fuel_type': 'petrol',
 'id': 'e4cf93ee-ae4b-5a94-a142-2495a0f3d548',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': '08FTDD',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ST70882',
 'listing': 'auction',
 'location': 'NL, Leeuwarden',
 'make': 'Renault',
 'model': 'Twingo',
 'odometer': 88984,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e4cf93ee-ae4b-5a94-a142-2495a0f3d548/e4cf93ee-ae4b-5a94-a142-2495a0f3d548_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 148005,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd1/a8/d1a8c3e162d76c7cb16d29605c4f5ea3/pa/ST70882_7d746e14799ae52f6cc2f208e616678a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e4cf93ee-ae4b-5a94-a142-2495a0f3d548/e4cf93ee-ae4b-5a94-a142-2495a0f3d548_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 120267,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd1/a8/d1a8c3e162d76c7cb16d29605c4f5ea3/pa/ST70882_47f4b01c4b5119b4e9418e2670037823.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e4cf93ee-ae4b-5a94-a142-2495a0f3d548/e4cf93ee-ae4b-5a94-a142-2495a0f3d548_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71297,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd1/a8/d1a8c3e162d76c7cb16d29605c4f5ea3/pa/ST70882_9ff651e084bc8e9c7ba5a82f4bc12f87.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e4cf93ee-ae4b-5a94-a142-2495a0f3d548/e4cf93ee-ae4b-5a94-a142-2495a0f3d548_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 84306,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd1/a8/d1a8c3e162d76c7cb16d29605c4f5ea3/pa/ST70882_9a1fcfef11eea70933db4e1bbe94e096.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e4cf93ee-ae4b-5a94-a142-2495a0f3d548/e4cf93ee-ae4b-5a94-a142-2495a0f3d548_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58363,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgd1/a8/d1a8c3e162d76c7cb16d29605c4f5ea3/pa/ST70882_6d532b901302924f6c0566dd38756f79.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2000-06-29',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Renault Twingo 1.2 Initiale Matic',
 'transmission': 'automatic',
 'trim': 'Initiale Matic',
 'year': 2000}
2026-03-27 12:10:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ST70882%27 HTTP/1.1" 200 None
2026-03-27 12:10:43 [auto1.nl] INFO: Saving data for ST70882: {'created_time': 1774613443.186935, 'last_price_update_time': 1774613443.186947, 'auction_closing_time': 1774714056.0}
2026-03-27 12:10:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='ST70882') HTTP/1.1" 204 0
2026-03-27 12:10:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: f2c29d93-16a6-508a-9123-64321ec59c9a with identifier: NV18219
2026-03-27 12:10:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: f2c29d93-16a6-508a-9123-64321ec59c9a with identifier: NV18219
2026-03-27 12:10:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: f2c29d93-16a6-508a-9123-64321ec59c9a with identifier: NV18219 to the API
2026-03-27 12:10:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 12:10:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 12:10:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img3b/8c/3b8c16a541993367e16bc3ec1e30bb94/pa/NV18219_4bf969347db9768f34235c6ca2972692.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 293,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '3.0L',
 'engine_horse_power': 230,
 'expiration_date': '2026-03-28T16:58:35Z',
 'fuel_type': 'petrol',
 'id': 'f2c29d93-16a6-508a-9123-64321ec59c9a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': '25RTTX',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NV18219',
 'listing': 'auction',
 'location': 'NL, Arnhem',
 'make': 'BMW',
 'model': 'X3',
 'odometer': 220479,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f2c29d93-16a6-508a-9123-64321ec59c9a/f2c29d93-16a6-508a-9123-64321ec59c9a_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 113573,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3b/8c/3b8c16a541993367e16bc3ec1e30bb94/pa/NV18219_4bf969347db9768f34235c6ca2972692.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f2c29d93-16a6-508a-9123-64321ec59c9a/f2c29d93-16a6-508a-9123-64321ec59c9a_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 123208,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3b/8c/3b8c16a541993367e16bc3ec1e30bb94/pa/NV18219_7eabbf1da822ae17b3086a0e2a05a79d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f2c29d93-16a6-508a-9123-64321ec59c9a/f2c29d93-16a6-508a-9123-64321ec59c9a_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90305,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3b/8c/3b8c16a541993367e16bc3ec1e30bb94/pa/NV18219_d681239ef1af9ad4ca3fe88b6194bee7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f2c29d93-16a6-508a-9123-64321ec59c9a/f2c29d93-16a6-508a-9123-64321ec59c9a_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 103722,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3b/8c/3b8c16a541993367e16bc3ec1e30bb94/pa/NV18219_96c6bb34ef61bd8d2d992e975275e10c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f2c29d93-16a6-508a-9123-64321ec59c9a/f2c29d93-16a6-508a-9123-64321ec59c9a_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71187,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img3b/8c/3b8c16a541993367e16bc3ec1e30bb94/pa/NV18219_be5a4b71e62d7468c4e979be416625c6.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2005-09-26',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW X3 3.0i',
 'transmission': 'automatic',
 'trim': '',
 'year': 2005}
2026-03-27 12:10:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NV18219%27 HTTP/1.1" 200 None
2026-03-27 12:10:43 [auto1.nl] INFO: Saving data for NV18219: {'created_time': 1774613443.547074, 'last_price_update_time': 1774613443.547085, 'auction_closing_time': 1774717115.0}
2026-03-27 12:10:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='NV18219') HTTP/1.1" 204 0
2026-03-27 12:10:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imga5/b3/a5b3ef4917dacddce86593a87fbf4245/pa/PA07201_0354e1fe8b2d60934635019cad3f3dc6.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:10:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 12:10:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 12:10:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 12:10:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 12:10:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 12:10:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GN83420> (referer: https://www.auto1.com/v1/car-details-view/GN83420/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 12:10:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 12:10:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:10:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7cfdf9b650>
2026-03-27 12:10:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:10:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:10:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:10:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_02ae6fc4-df0c-537e-bfeb-79779142b37c/02ae6fc4-df0c-537e-bfeb-79779142b37c_image_2.jpg HTTP/1.1" 201 0
2026-03-27 12:10:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0f%252Fc7%252F0fc7f4b96d6c761f832997fbab669e9c%252Fpa%252FSY53039_a1d4704d3b1d573cd736e156dc307656.jpg') HTTP/1.1" 204 0
2026-03-27 12:10:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0f/c7/0fc7f4b96d6c761f832997fbab669e9c/pa/SY53039_a1d4704d3b1d573cd736e156dc307656.jpg saved to cache
2026-03-27 12:10:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 02ae6fc4-df0c-537e-bfeb-79779142b37c
2026-03-27 12:10:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:10:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7cfe0a8cd0>
2026-03-27 12:10:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:10:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:10:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:10:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aaeb7602-4138-550e-88fa-de8627c49056/aaeb7602-4138-550e-88fa-de8627c49056_image_2.jpg HTTP/1.1" 201 0
2026-03-27 12:10:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg96%252F9d%252F969d1a04c2996f89d3e4f893f4070169%252Fpa%252FFK39304_05e734694292b20cc7e64a05ad2c52e6.jpg') HTTP/1.1" 204 0
2026-03-27 12:10:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img96/9d/969d1a04c2996f89d3e4f893f4070169/pa/FK39304_05e734694292b20cc7e64a05ad2c52e6.jpg saved to cache
2026-03-27 12:10:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item aaeb7602-4138-550e-88fa-de8627c49056
2026-03-27 12:10:43 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: aaeb7602-4138-550e-88fa-de8627c49056, skipping ID generation
2026-03-27 12:10:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item aaeb7602-4138-550e-88fa-de8627c49056 with scrape type 1
2026-03-27 12:10:43 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item aaeb7602-4138-550e-88fa-de8627c49056 sending to next pipeline
2026-03-27 12:10:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: aaeb7602-4138-550e-88fa-de8627c49056, identifier: FK39304
2026-03-27 12:10:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: aaeb7602-4138-550e-88fa-de8627c49056 with identifier: FK39304
2026-03-27 12:10:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-27 12:10:43 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=red HTTP/1.1" 200 None
2026-03-27 12:10:43 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 12:10:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-27 12:10:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: aaeb7602-4138-550e-88fa-de8627c49056 with identifier: FK39304
2026-03-27 12:10:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: aaeb7602-4138-550e-88fa-de8627c49056 with identifier: FK39304 to the API
2026-03-27 12:10:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 12:10:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 12:10:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img96/9d/969d1a04c2996f89d3e4f893f4070169/pa/FK39304_05e734694292b20cc7e64a05ad2c52e6.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:15:16Z',
 'fuel_type': 'petrol',
 'id': 'aaeb7602-4138-550e-88fa-de8627c49056',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'XG838G',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FK39304',
 'listing': 'auction',
 'location': 'NL, Den Haag',
 'make': 'Peugeot',
 'model': '208',
 'odometer': 82466,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aaeb7602-4138-550e-88fa-de8627c49056/aaeb7602-4138-550e-88fa-de8627c49056_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73792,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img96/9d/969d1a04c2996f89d3e4f893f4070169/pa/FK39304_d348adefa177e88d0d34d9c347edc5a7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aaeb7602-4138-550e-88fa-de8627c49056/aaeb7602-4138-550e-88fa-de8627c49056_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73671,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img96/9d/969d1a04c2996f89d3e4f893f4070169/pa/FK39304_c201ea8bade707732ea39c9d9153e896.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aaeb7602-4138-550e-88fa-de8627c49056/aaeb7602-4138-550e-88fa-de8627c49056_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76457,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img96/9d/969d1a04c2996f89d3e4f893f4070169/pa/FK39304_05e734694292b20cc7e64a05ad2c52e6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aaeb7602-4138-550e-88fa-de8627c49056/aaeb7602-4138-550e-88fa-de8627c49056_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73065,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img96/9d/969d1a04c2996f89d3e4f893f4070169/pa/FK39304_95aee116dc4e3182190f2e0b81159531.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aaeb7602-4138-550e-88fa-de8627c49056/aaeb7602-4138-550e-88fa-de8627c49056_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2391478,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img96/9d/969d1a04c2996f89d3e4f893f4070169/pa/FK39304_fdd281f63e939662829751cfadf43ef3.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aaeb7602-4138-550e-88fa-de8627c49056/aaeb7602-4138-550e-88fa-de8627c49056_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2357488,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img96/9d/969d1a04c2996f89d3e4f893f4070169/pa/FK39304_4b9a8759e5637cf1a79252970f04cd7c.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aaeb7602-4138-550e-88fa-de8627c49056/aaeb7602-4138-550e-88fa-de8627c49056_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2399317,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img96/9d/969d1a04c2996f89d3e4f893f4070169/pa/FK39304_d229e7d84dfd4882526031da66484814.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aaeb7602-4138-550e-88fa-de8627c49056/aaeb7602-4138-550e-88fa-de8627c49056_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72166,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img96/9d/969d1a04c2996f89d3e4f893f4070169/pa/FK39304_0f7bb0c7fdc9a07f861cf9b9de7f2f8e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aaeb7602-4138-550e-88fa-de8627c49056/aaeb7602-4138-550e-88fa-de8627c49056_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2378461,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img96/9d/969d1a04c2996f89d3e4f893f4070169/pa/FK39304_14332e445155f40b2313e89ef23a560a.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aaeb7602-4138-550e-88fa-de8627c49056/aaeb7602-4138-550e-88fa-de8627c49056_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78871,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img96/9d/969d1a04c2996f89d3e4f893f4070169/pa/FK39304_905f1cddb0eb8e73b799b6c2de0caedb.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-02-15',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 208 1.2 PureTech Allure',
 'transmission': 'manual',
 'trim': 'Allure',
 'year': 2019}
2026-03-27 12:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FK39304%27 HTTP/1.1" 200 None
2026-03-27 12:10:44 [auto1.nl] INFO: Saving data for FK39304: {'created_time': 1774613444.282703, 'last_price_update_time': 1774613444.282713, 'auction_closing_time': 1774714516.0}
2026-03-27 12:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='FK39304') HTTP/1.1" 204 0
2026-03-27 12:10:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img78/ac/78acb5626ad2a880cfc7b5d9a1a3ecc2/pa/JD39017_dcab0508083a7c3465059d01314e49bd.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:10:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img78/ac/78acb5626ad2a880cfc7b5d9a1a3ecc2/pa/JD39017_39f228202419225f3bbb49e770abc36e.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:10:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img78/ac/78acb5626ad2a880cfc7b5d9a1a3ecc2/pa/JD39017_d97d01fdede0d147f5a9b072668d2219.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:10:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:10:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7cfe0bfc50>
2026-03-27 12:10:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:10:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:10:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:10:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c82a1fc8-55b0-54f1-b687-49855322d40e/c82a1fc8-55b0-54f1-b687-49855322d40e_image_0.jpg HTTP/1.1" 201 0
2026-03-27 12:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimga5%252Fb3%252Fa5b3ef4917dacddce86593a87fbf4245%252Fpa%252FPA07201_0354e1fe8b2d60934635019cad3f3dc6.jpg') HTTP/1.1" 204 0
2026-03-27 12:10:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imga5/b3/a5b3ef4917dacddce86593a87fbf4245/pa/PA07201_0354e1fe8b2d60934635019cad3f3dc6.jpg saved to cache
2026-03-27 12:10:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c82a1fc8-55b0-54f1-b687-49855322d40e
2026-03-27 12:10:44 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c82a1fc8-55b0-54f1-b687-49855322d40e, skipping ID generation
2026-03-27 12:10:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c82a1fc8-55b0-54f1-b687-49855322d40e with scrape type 1
2026-03-27 12:10:44 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c82a1fc8-55b0-54f1-b687-49855322d40e sending to next pipeline
2026-03-27 12:10:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: c82a1fc8-55b0-54f1-b687-49855322d40e, identifier: PA07201
2026-03-27 12:10:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 49715ebb-1a83-5042-b7d1-86a59d60b4e0 with identifier: GN83420
2026-03-27 12:10:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 49715ebb-1a83-5042-b7d1-86a59d60b4e0 with scrape type 1
2026-03-27 12:10:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 49715ebb-1a83-5042-b7d1-86a59d60b4e0
2026-03-27 12:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252Fee%252F99eeba41ad1fffb1e6ccb0d7f8aee590%252Fpa%252FGN83420_1a1a67fdd52c4503712d4617f89daa70.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:10:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/ee/99eeba41ad1fffb1e6ccb0d7f8aee590/pa/GN83420_1a1a67fdd52c4503712d4617f89daa70.jpg not downloaded yet
2026-03-27 12:10:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: c82a1fc8-55b0-54f1-b687-49855322d40e with identifier: PA07201
2026-03-27 12:10:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: c82a1fc8-55b0-54f1-b687-49855322d40e with identifier: PA07201
2026-03-27 12:10:44 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: c82a1fc8-55b0-54f1-b687-49855322d40e with identifier: PA07201 to the API
2026-03-27 12:10:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 12:10:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 12:10:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imga5/b3/a5b3ef4917dacddce86593a87fbf4245/pa/PA07201_0354e1fe8b2d60934635019cad3f3dc6.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '1.2L',
 'engine_horse_power': 60,
 'expiration_date': '2026-03-28T16:57:49Z',
 'fuel_type': 'petrol',
 'id': 'c82a1fc8-55b0-54f1-b687-49855322d40e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': '61SFNN',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PA07201',
 'listing': 'auction',
 'location': 'NL, Enschede',
 'make': 'Fiat',
 'model': 'Panda',
 'odometer': 152113,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 4,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c82a1fc8-55b0-54f1-b687-49855322d40e/c82a1fc8-55b0-54f1-b687-49855322d40e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83806,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga5/b3/a5b3ef4917dacddce86593a87fbf4245/pa/PA07201_0354e1fe8b2d60934635019cad3f3dc6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c82a1fc8-55b0-54f1-b687-49855322d40e/c82a1fc8-55b0-54f1-b687-49855322d40e_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77423,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga5/b3/a5b3ef4917dacddce86593a87fbf4245/pa/PA07201_d564b063c4101d29e50a6c6f818aaf08.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c82a1fc8-55b0-54f1-b687-49855322d40e/c82a1fc8-55b0-54f1-b687-49855322d40e_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71045,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga5/b3/a5b3ef4917dacddce86593a87fbf4245/pa/PA07201_9c7418ff0e9af41f0692afb28800978a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c82a1fc8-55b0-54f1-b687-49855322d40e/c82a1fc8-55b0-54f1-b687-49855322d40e_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64799,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imga5/b3/a5b3ef4917dacddce86593a87fbf4245/pa/PA07201_ebdebaa1f1186e5ca39a232a861ae316.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2005-12-29',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Fiat Panda 1.2 Dynamic',
 'transmission': 'manual',
 'trim': 'Dynamic',
 'year': 2005}
2026-03-27 12:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PA07201%27 HTTP/1.1" 200 None
2026-03-27 12:10:44 [auto1.nl] INFO: Saving data for PA07201: {'created_time': 1774613444.852499, 'last_price_update_time': 1774613444.852509, 'auction_closing_time': 1774717069.0}
2026-03-27 12:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='PA07201') HTTP/1.1" 204 0
2026-03-27 12:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252Fee%252F99eeba41ad1fffb1e6ccb0d7f8aee590%252Fpa%252FGN83420_7c9adbfcce91f7508da47b62896caa78.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:10:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/ee/99eeba41ad1fffb1e6ccb0d7f8aee590/pa/GN83420_7c9adbfcce91f7508da47b62896caa78.jpg not downloaded yet
2026-03-27 12:10:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:10:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7cfeed7650>
2026-03-27 12:10:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:10:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:10:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:10:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c46c1323-b991-57d9-81ae-bd78bb9d4c4e/c46c1323-b991-57d9-81ae-bd78bb9d4c4e_image_9.jpg HTTP/1.1" 201 0
2026-03-27 12:10:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg78%252Fac%252F78acb5626ad2a880cfc7b5d9a1a3ecc2%252Fpa%252FJD39017_dcab0508083a7c3465059d01314e49bd.jpg') HTTP/1.1" 204 0
2026-03-27 12:10:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/ac/78acb5626ad2a880cfc7b5d9a1a3ecc2/pa/JD39017_dcab0508083a7c3465059d01314e49bd.jpg saved to cache
2026-03-27 12:10:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item c46c1323-b991-57d9-81ae-bd78bb9d4c4e
2026-03-27 12:10:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:10:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7cfe15b510>
2026-03-27 12:10:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:10:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:10:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:10:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c46c1323-b991-57d9-81ae-bd78bb9d4c4e/c46c1323-b991-57d9-81ae-bd78bb9d4c4e_image_7.jpg HTTP/1.1" 201 0
2026-03-27 12:10:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg78%252Fac%252F78acb5626ad2a880cfc7b5d9a1a3ecc2%252Fpa%252FJD39017_39f228202419225f3bbb49e770abc36e.jpg') HTTP/1.1" 204 0
2026-03-27 12:10:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/ac/78acb5626ad2a880cfc7b5d9a1a3ecc2/pa/JD39017_39f228202419225f3bbb49e770abc36e.jpg saved to cache
2026-03-27 12:10:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c46c1323-b991-57d9-81ae-bd78bb9d4c4e
2026-03-27 12:10:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:10:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7cfe2356d0>
2026-03-27 12:10:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:10:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:10:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:10:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c46c1323-b991-57d9-81ae-bd78bb9d4c4e/c46c1323-b991-57d9-81ae-bd78bb9d4c4e_image_6.jpg HTTP/1.1" 201 0
2026-03-27 12:10:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg78%252Fac%252F78acb5626ad2a880cfc7b5d9a1a3ecc2%252Fpa%252FJD39017_d97d01fdede0d147f5a9b072668d2219.jpg') HTTP/1.1" 204 0
2026-03-27 12:10:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img78/ac/78acb5626ad2a880cfc7b5d9a1a3ecc2/pa/JD39017_d97d01fdede0d147f5a9b072668d2219.jpg saved to cache
2026-03-27 12:10:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c46c1323-b991-57d9-81ae-bd78bb9d4c4e
2026-03-27 12:10:45 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c46c1323-b991-57d9-81ae-bd78bb9d4c4e, skipping ID generation
2026-03-27 12:10:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c46c1323-b991-57d9-81ae-bd78bb9d4c4e with scrape type 1
2026-03-27 12:10:45 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c46c1323-b991-57d9-81ae-bd78bb9d4c4e sending to next pipeline
2026-03-27 12:10:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: c46c1323-b991-57d9-81ae-bd78bb9d4c4e, identifier: JD39017
2026-03-27 12:10:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252Fee%252F99eeba41ad1fffb1e6ccb0d7f8aee590%252Fpa%252FGN83420_b99fb0855f418f86eab3fdabfb97202b.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:10:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/ee/99eeba41ad1fffb1e6ccb0d7f8aee590/pa/GN83420_b99fb0855f418f86eab3fdabfb97202b.jpg not downloaded yet
2026-03-27 12:10:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: c46c1323-b991-57d9-81ae-bd78bb9d4c4e with identifier: JD39017
2026-03-27 12:10:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: c46c1323-b991-57d9-81ae-bd78bb9d4c4e with identifier: JD39017
2026-03-27 12:10:45 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: c46c1323-b991-57d9-81ae-bd78bb9d4c4e with identifier: JD39017 to the API
2026-03-27 12:10:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 12:10:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 12:10:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img78/ac/78acb5626ad2a880cfc7b5d9a1a3ecc2/pa/JD39017_d97d01fdede0d147f5a9b072668d2219.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.6L',
 'engine_horse_power': 155,
 'expiration_date': '2026-03-28T16:00:43Z',
 'fuel_type': 'petrol',
 'id': 'c46c1323-b991-57d9-81ae-bd78bb9d4c4e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JD39017',
 'listing': 'auction',
 'location': 'NL',
 'make': 'Peugeot',
 'model': '3008',
 'odometer': 92866,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 23,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c46c1323-b991-57d9-81ae-bd78bb9d4c4e/c46c1323-b991-57d9-81ae-bd78bb9d4c4e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91315,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img78/ac/78acb5626ad2a880cfc7b5d9a1a3ecc2/pa/JD39017_ec71bcd2337f6b57b7dc911ba0a0edae.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c46c1323-b991-57d9-81ae-bd78bb9d4c4e/c46c1323-b991-57d9-81ae-bd78bb9d4c4e_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 95772,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img78/ac/78acb5626ad2a880cfc7b5d9a1a3ecc2/pa/JD39017_7541e436ca54549a8f15ab4e02907d5d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c46c1323-b991-57d9-81ae-bd78bb9d4c4e/c46c1323-b991-57d9-81ae-bd78bb9d4c4e_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92998,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img78/ac/78acb5626ad2a880cfc7b5d9a1a3ecc2/pa/JD39017_b55fcb7567355e34df49a28cc8872bd3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c46c1323-b991-57d9-81ae-bd78bb9d4c4e/c46c1323-b991-57d9-81ae-bd78bb9d4c4e_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86884,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img78/ac/78acb5626ad2a880cfc7b5d9a1a3ecc2/pa/JD39017_22adf2c3693daa569d921cc28128cf69.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c46c1323-b991-57d9-81ae-bd78bb9d4c4e/c46c1323-b991-57d9-81ae-bd78bb9d4c4e_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85787,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img78/ac/78acb5626ad2a880cfc7b5d9a1a3ecc2/pa/JD39017_8c7d0547dd629c42d290e5803b7bcf9d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c46c1323-b991-57d9-81ae-bd78bb9d4c4e/c46c1323-b991-57d9-81ae-bd78bb9d4c4e_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86327,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img78/ac/78acb5626ad2a880cfc7b5d9a1a3ecc2/pa/JD39017_f48398212104d506cafddfc9fcd43dbd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c46c1323-b991-57d9-81ae-bd78bb9d4c4e/c46c1323-b991-57d9-81ae-bd78bb9d4c4e_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 85270,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img78/ac/78acb5626ad2a880cfc7b5d9a1a3ecc2/pa/JD39017_d97d01fdede0d147f5a9b072668d2219.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c46c1323-b991-57d9-81ae-bd78bb9d4c4e/c46c1323-b991-57d9-81ae-bd78bb9d4c4e_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 122928,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img78/ac/78acb5626ad2a880cfc7b5d9a1a3ecc2/pa/JD39017_39f228202419225f3bbb49e770abc36e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c46c1323-b991-57d9-81ae-bd78bb9d4c4e/c46c1323-b991-57d9-81ae-bd78bb9d4c4e_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76650,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img78/ac/78acb5626ad2a880cfc7b5d9a1a3ecc2/pa/JD39017_99a0d490c801b490f3cded313cdbf915.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c46c1323-b991-57d9-81ae-bd78bb9d4c4e/c46c1323-b991-57d9-81ae-bd78bb9d4c4e_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77893,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img78/ac/78acb5626ad2a880cfc7b5d9a1a3ecc2/pa/JD39017_dcab0508083a7c3465059d01314e49bd.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2012-10-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 3008 1.6 THP Allure',
 'transmission': 'automatic',
 'trim': 'Allure',
 'year': 2012}
2026-03-27 12:10:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JD39017%27 HTTP/1.1" 200 None
2026-03-27 12:10:45 [auto1.nl] INFO: Saving data for JD39017: {'created_time': 1774613445.570664, 'last_price_update_time': 1774613445.570673, 'auction_closing_time': 1774713643.0}
2026-03-27 12:10:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='JD39017') HTTP/1.1" 204 0
2026-03-27 12:10:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252Fee%252F99eeba41ad1fffb1e6ccb0d7f8aee590%252Fpa%252FGN83420_36aa5211913e6d5eb988e9d2fd76e1f7.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:10:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/ee/99eeba41ad1fffb1e6ccb0d7f8aee590/pa/GN83420_36aa5211913e6d5eb988e9d2fd76e1f7.jpg not downloaded yet
2026-03-27 12:10:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DA49617/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 12:10:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 12:10:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252Fee%252F99eeba41ad1fffb1e6ccb0d7f8aee590%252Fpa%252FGN83420_73bee539d44078d956961f11c8211de6.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:10:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/ee/99eeba41ad1fffb1e6ccb0d7f8aee590/pa/GN83420_73bee539d44078d956961f11c8211de6.jpg not downloaded yet
2026-03-27 12:10:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252Fee%252F99eeba41ad1fffb1e6ccb0d7f8aee590%252Fpa%252FGN83420_eafe96afa782ae695d1fd8df204dbe1c.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:10:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/ee/99eeba41ad1fffb1e6ccb0d7f8aee590/pa/GN83420_eafe96afa782ae695d1fd8df204dbe1c.jpg not downloaded yet
2026-03-27 12:10:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252Fee%252F99eeba41ad1fffb1e6ccb0d7f8aee590%252Fpa%252FGN83420_d063c735f78e8fd09f2937152d85793a.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:10:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/ee/99eeba41ad1fffb1e6ccb0d7f8aee590/pa/GN83420_d063c735f78e8fd09f2937152d85793a.jpg not downloaded yet
2026-03-27 12:10:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252Fee%252F99eeba41ad1fffb1e6ccb0d7f8aee590%252Fpa%252FGN83420_a07e5d2484c55a8f67cc124705ef64b0.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:10:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/ee/99eeba41ad1fffb1e6ccb0d7f8aee590/pa/GN83420_a07e5d2484c55a8f67cc124705ef64b0.jpg not downloaded yet
2026-03-27 12:10:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img99/ee/99eeba41ad1fffb1e6ccb0d7f8aee590/pa/GN83420_1a1a67fdd52c4503712d4617f89daa70.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:10:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252Fee%252F99eeba41ad1fffb1e6ccb0d7f8aee590%252Fpa%252FGN83420_dcf9a95ecd755420395401fd4ff7c0c9.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:10:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/ee/99eeba41ad1fffb1e6ccb0d7f8aee590/pa/GN83420_dcf9a95ecd755420395401fd4ff7c0c9.jpg not downloaded yet
2026-03-27 12:10:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252Fee%252F99eeba41ad1fffb1e6ccb0d7f8aee590%252Fpa%252FGN83420_4c62f4d9cf26142466d9b37fd656b5a5.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:10:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/ee/99eeba41ad1fffb1e6ccb0d7f8aee590/pa/GN83420_4c62f4d9cf26142466d9b37fd656b5a5.jpg not downloaded yet
2026-03-27 12:10:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/NY57976/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 12:10:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img1e/af/1eafd7fe25d766059ffa3f84ac586728/pa/HA14742_824a4f645a921f58b4f47096fce5fc52.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:10:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 12:10:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FC64695> (referer: https://www.auto1.com/v1/car-details-view/FC64695/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 12:10:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GP63449> (referer: https://www.auto1.com/v1/car-details-view/GP63449/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 12:10:45 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 12:10:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img0f/c7/0fc7f4b96d6c761f832997fbab669e9c/pa/SY53039_9be766df4b88efe8f7a45219466175ec.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:10:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DZ37745/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 12:10:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:10:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7d0dc67910>
2026-03-27 12:10:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:10:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:10:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:10:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_49715ebb-1a83-5042-b7d1-86a59d60b4e0/49715ebb-1a83-5042-b7d1-86a59d60b4e0_image_0.jpg HTTP/1.1" 201 0
2026-03-27 12:10:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252Fee%252F99eeba41ad1fffb1e6ccb0d7f8aee590%252Fpa%252FGN83420_1a1a67fdd52c4503712d4617f89daa70.jpg') HTTP/1.1" 204 0
2026-03-27 12:10:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/ee/99eeba41ad1fffb1e6ccb0d7f8aee590/pa/GN83420_1a1a67fdd52c4503712d4617f89daa70.jpg saved to cache
2026-03-27 12:10:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 49715ebb-1a83-5042-b7d1-86a59d60b4e0
2026-03-27 12:10:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BU16200/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 12:10:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img99/ee/99eeba41ad1fffb1e6ccb0d7f8aee590/pa/GN83420_a07e5d2484c55a8f67cc124705ef64b0.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:10:45 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 12:10:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:10:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7cfe0aa3d0>
2026-03-27 12:10:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:10:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:10:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:10:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7218c6b3-850a-55af-b95d-11797d99af57/7218c6b3-850a-55af-b95d-11797d99af57_image_3.jpg HTTP/1.1" 201 0
2026-03-27 12:10:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg1e%252Faf%252F1eafd7fe25d766059ffa3f84ac586728%252Fpa%252FHA14742_824a4f645a921f58b4f47096fce5fc52.jpg') HTTP/1.1" 204 0
2026-03-27 12:10:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img1e/af/1eafd7fe25d766059ffa3f84ac586728/pa/HA14742_824a4f645a921f58b4f47096fce5fc52.jpg saved to cache
2026-03-27 12:10:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 7218c6b3-850a-55af-b95d-11797d99af57
2026-03-27 12:10:45 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7218c6b3-850a-55af-b95d-11797d99af57, skipping ID generation
2026-03-27 12:10:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7218c6b3-850a-55af-b95d-11797d99af57 with scrape type 1
2026-03-27 12:10:45 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7218c6b3-850a-55af-b95d-11797d99af57 sending to next pipeline
2026-03-27 12:10:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 7218c6b3-850a-55af-b95d-11797d99af57, identifier: HA14742
2026-03-27 12:10:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b440c16f-9729-50c4-b006-0c0325ae9f89 with identifier: FC64695
2026-03-27 12:10:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b440c16f-9729-50c4-b006-0c0325ae9f89 with scrape type 1
2026-03-27 12:10:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item b440c16f-9729-50c4-b006-0c0325ae9f89
2026-03-27 12:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcb%252Ffc%252Fcbfc9ae35f44f6834a7cc90d595d5606%252Fpa%252FFC64695_279478edc7b4da1ddac3d4aabe6e6c88.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:10:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/fc/cbfc9ae35f44f6834a7cc90d595d5606/pa/FC64695_279478edc7b4da1ddac3d4aabe6e6c88.jpg not downloaded yet
2026-03-27 12:10:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 22e334de-e05e-58a4-a382-d478bd0810e7 with identifier: GP63449
2026-03-27 12:10:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 22e334de-e05e-58a4-a382-d478bd0810e7 with scrape type 1
2026-03-27 12:10:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 22e334de-e05e-58a4-a382-d478bd0810e7
2026-03-27 12:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252F13%252F75130f334152394286ffdc88cd95c101%252Fpa%252FGP63449_4a86d48071c50a03ce30b16768213318.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:10:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/13/75130f334152394286ffdc88cd95c101/pa/GP63449_4a86d48071c50a03ce30b16768213318.jpg already downloaded
2026-03-27 12:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252F13%252F75130f334152394286ffdc88cd95c101%252Fpa%252FGP63449_197252084ff0a8b3e916988a09958377.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:10:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/13/75130f334152394286ffdc88cd95c101/pa/GP63449_197252084ff0a8b3e916988a09958377.jpg already downloaded
2026-03-27 12:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252F13%252F75130f334152394286ffdc88cd95c101%252Fpa%252FGP63449_44b8b10054f2f1390cb45cbb02dad6c6.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:10:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/13/75130f334152394286ffdc88cd95c101/pa/GP63449_44b8b10054f2f1390cb45cbb02dad6c6.jpg already downloaded
2026-03-27 12:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252F13%252F75130f334152394286ffdc88cd95c101%252Fpa%252FGP63449_efea0d26d20786d6c2a5be59864ad717.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:10:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/13/75130f334152394286ffdc88cd95c101/pa/GP63449_efea0d26d20786d6c2a5be59864ad717.jpg already downloaded
2026-03-27 12:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252F13%252F75130f334152394286ffdc88cd95c101%252Fpa%252FGP63449_5286c2f5b9acf841372aa538afbdd6c0.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:10:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/13/75130f334152394286ffdc88cd95c101/pa/GP63449_5286c2f5b9acf841372aa538afbdd6c0.jpg already downloaded
2026-03-27 12:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252F13%252F75130f334152394286ffdc88cd95c101%252Fpa%252FGP63449_0a07d5061ad19f1a99709d0f87a51981.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:10:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/13/75130f334152394286ffdc88cd95c101/pa/GP63449_0a07d5061ad19f1a99709d0f87a51981.jpg already downloaded
2026-03-27 12:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252F13%252F75130f334152394286ffdc88cd95c101%252Fpa%252FGP63449_b74b0167dee7d33b43ecbda8c48251cb.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:10:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/13/75130f334152394286ffdc88cd95c101/pa/GP63449_b74b0167dee7d33b43ecbda8c48251cb.jpg already downloaded
2026-03-27 12:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252F13%252F75130f334152394286ffdc88cd95c101%252Fpa%252FGP63449_1f9f6b2420fc74c8d859c0d1c787ed31.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:10:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/13/75130f334152394286ffdc88cd95c101/pa/GP63449_1f9f6b2420fc74c8d859c0d1c787ed31.jpg already downloaded
2026-03-27 12:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252F13%252F75130f334152394286ffdc88cd95c101%252Fpa%252FGP63449_3e7bc929620e0032152e1c1a3c6c7d2a.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:10:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/13/75130f334152394286ffdc88cd95c101/pa/GP63449_3e7bc929620e0032152e1c1a3c6c7d2a.jpg already downloaded
2026-03-27 12:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg75%252F13%252F75130f334152394286ffdc88cd95c101%252Fpa%252FGP63449_6e1df841363730921b5047bba0c31e7b.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:10:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img75/13/75130f334152394286ffdc88cd95c101/pa/GP63449_6e1df841363730921b5047bba0c31e7b.jpg already downloaded
2026-03-27 12:10:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 22e334de-e05e-58a4-a382-d478bd0810e7, identifier: GP63449
2026-03-27 12:10:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 7218c6b3-850a-55af-b95d-11797d99af57 with identifier: HA14742
2026-03-27 12:10:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 7218c6b3-850a-55af-b95d-11797d99af57 with identifier: HA14742
2026-03-27 12:10:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 7218c6b3-850a-55af-b95d-11797d99af57 with identifier: HA14742 to the API
2026-03-27 12:10:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 12:10:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 12:10:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img1e/af/1eafd7fe25d766059ffa3f84ac586728/pa/HA14742_824a4f645a921f58b4f47096fce5fc52.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '0.9L',
 'engine_horse_power': 85,
 'expiration_date': '2026-03-28T16:29:41Z',
 'fuel_type': 'petrol',
 'id': '7218c6b3-850a-55af-b95d-11797d99af57',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': '64ZVS9',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HA14742',
 'listing': 'auction',
 'location': "NL, 's-Gravenzande",
 'make': 'Fiat',
 'model': 'Panda',
 'odometer': 16164,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7218c6b3-850a-55af-b95d-11797d99af57/7218c6b3-850a-55af-b95d-11797d99af57_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2262734,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img1e/af/1eafd7fe25d766059ffa3f84ac586728/pa/HA14742_cc5405454c585b6f9cb49a9d4514f432.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7218c6b3-850a-55af-b95d-11797d99af57/7218c6b3-850a-55af-b95d-11797d99af57_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 52180,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1e/af/1eafd7fe25d766059ffa3f84ac586728/pa/HA14742_12a4bc80666ba3545ff991cf8dd2448e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7218c6b3-850a-55af-b95d-11797d99af57/7218c6b3-850a-55af-b95d-11797d99af57_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2171160,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img1e/af/1eafd7fe25d766059ffa3f84ac586728/pa/HA14742_ca139f98fbca4fc975270c1ac32c88f5.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7218c6b3-850a-55af-b95d-11797d99af57/7218c6b3-850a-55af-b95d-11797d99af57_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2216678,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img1e/af/1eafd7fe25d766059ffa3f84ac586728/pa/HA14742_824a4f645a921f58b4f47096fce5fc52.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7218c6b3-850a-55af-b95d-11797d99af57/7218c6b3-850a-55af-b95d-11797d99af57_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2148604,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img1e/af/1eafd7fe25d766059ffa3f84ac586728/pa/HA14742_7aba7bd82321365dbd008d1e623ed69c.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7218c6b3-850a-55af-b95d-11797d99af57/7218c6b3-850a-55af-b95d-11797d99af57_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 48894,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1e/af/1eafd7fe25d766059ffa3f84ac586728/pa/HA14742_aead33d45333115910cddfd7785d62c1.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7218c6b3-850a-55af-b95d-11797d99af57/7218c6b3-850a-55af-b95d-11797d99af57_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 45484,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1e/af/1eafd7fe25d766059ffa3f84ac586728/pa/HA14742_f204816fb677d5bcdd9b0957652b37fb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7218c6b3-850a-55af-b95d-11797d99af57/7218c6b3-850a-55af-b95d-11797d99af57_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 49732,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1e/af/1eafd7fe25d766059ffa3f84ac586728/pa/HA14742_3d1f2a316e08c6c32e291337fc9fd76f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7218c6b3-850a-55af-b95d-11797d99af57/7218c6b3-850a-55af-b95d-11797d99af57_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59075,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1e/af/1eafd7fe25d766059ffa3f84ac586728/pa/HA14742_3a893b1aa37adc1b2e1fc12b4e52e92a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7218c6b3-850a-55af-b95d-11797d99af57/7218c6b3-850a-55af-b95d-11797d99af57_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54088,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img1e/af/1eafd7fe25d766059ffa3f84ac586728/pa/HA14742_8a02d5750f9b44fad725fdc29001c72c.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2013-02-27',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Fiat Panda 0.9 Lounge',
 'transmission': 'automatic',
 'trim': 'Lounge',
 'year': 2013}
2026-03-27 12:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HA14742%27 HTTP/1.1" 200 None
2026-03-27 12:10:46 [auto1.nl] INFO: Saving data for HA14742: {'created_time': 1774613446.732619, 'last_price_update_time': 1774613446.732633, 'auction_closing_time': 1774715381.0}
2026-03-27 12:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='HA14742') HTTP/1.1" 204 0
2026-03-27 12:10:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 22e334de-e05e-58a4-a382-d478bd0810e7 with identifier: GP63449
2026-03-27 12:10:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 22e334de-e05e-58a4-a382-d478bd0810e7 with identifier: GP63449
2026-03-27 12:10:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 22e334de-e05e-58a4-a382-d478bd0810e7 with identifier: GP63449 to the API
2026-03-27 12:10:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 12:10:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 12:10:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/GP63449>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '2.0L',
 'engine_horse_power': 203,
 'expiration_date': '2026-03-28T16:40:50Z',
 'fuel_type': 'hybrid',
 'id': '22e334de-e05e-58a4-a382-d478bd0810e7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': '7STP14',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GP63449',
 'listing': 'auction',
 'location': 'NL, Dordrecht',
 'make': 'Mitsubishi',
 'model': 'Outlander',
 'odometer': 250449,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img75/13/75130f334152394286ffdc88cd95c101/pa/GP63449_4a86d48071c50a03ce30b16768213318.jpg',
                'https://img-pa.auto1.com/img75/13/75130f334152394286ffdc88cd95c101/pa/GP63449_197252084ff0a8b3e916988a09958377.jpg',
                'https://img-pa.auto1.com/img75/13/75130f334152394286ffdc88cd95c101/pa/GP63449_44b8b10054f2f1390cb45cbb02dad6c6.jpg',
                'https://img-pa.auto1.com/img75/13/75130f334152394286ffdc88cd95c101/pa/GP63449_efea0d26d20786d6c2a5be59864ad717.jpg',
                'https://img-pa.auto1.com/img75/13/75130f334152394286ffdc88cd95c101/pa/GP63449_5286c2f5b9acf841372aa538afbdd6c0.jpg',
                'https://img-pa.auto1.com/img75/13/75130f334152394286ffdc88cd95c101/pa/GP63449_0a07d5061ad19f1a99709d0f87a51981.jpg',
                'https://img-pa.auto1.com/img75/13/75130f334152394286ffdc88cd95c101/pa/GP63449_b74b0167dee7d33b43ecbda8c48251cb.jpg',
                'https://img-pa.auto1.com/img75/13/75130f334152394286ffdc88cd95c101/pa/GP63449_1f9f6b2420fc74c8d859c0d1c787ed31.jpg',
                'https://img-pa.auto1.com/img75/13/75130f334152394286ffdc88cd95c101/pa/GP63449_3e7bc929620e0032152e1c1a3c6c7d2a.jpg',
                'https://img-pa.auto1.com/img75/13/75130f334152394286ffdc88cd95c101/pa/GP63449_6e1df841363730921b5047bba0c31e7b.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_22e334de-e05e-58a4-a382-d478bd0810e7/22e334de-e05e-58a4-a382-d478bd0810e7_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3503169,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img75/13/75130f334152394286ffdc88cd95c101/pa/GP63449_4a86d48071c50a03ce30b16768213318.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_22e334de-e05e-58a4-a382-d478bd0810e7/22e334de-e05e-58a4-a382-d478bd0810e7_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3379398,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img75/13/75130f334152394286ffdc88cd95c101/pa/GP63449_197252084ff0a8b3e916988a09958377.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_22e334de-e05e-58a4-a382-d478bd0810e7/22e334de-e05e-58a4-a382-d478bd0810e7_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 106990,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img75/13/75130f334152394286ffdc88cd95c101/pa/GP63449_44b8b10054f2f1390cb45cbb02dad6c6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_22e334de-e05e-58a4-a382-d478bd0810e7/22e334de-e05e-58a4-a382-d478bd0810e7_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75845,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img75/13/75130f334152394286ffdc88cd95c101/pa/GP63449_efea0d26d20786d6c2a5be59864ad717.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_22e334de-e05e-58a4-a382-d478bd0810e7/22e334de-e05e-58a4-a382-d478bd0810e7_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 97353,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img75/13/75130f334152394286ffdc88cd95c101/pa/GP63449_5286c2f5b9acf841372aa538afbdd6c0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_22e334de-e05e-58a4-a382-d478bd0810e7/22e334de-e05e-58a4-a382-d478bd0810e7_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3341881,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img75/13/75130f334152394286ffdc88cd95c101/pa/GP63449_0a07d5061ad19f1a99709d0f87a51981.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_22e334de-e05e-58a4-a382-d478bd0810e7/22e334de-e05e-58a4-a382-d478bd0810e7_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71257,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img75/13/75130f334152394286ffdc88cd95c101/pa/GP63449_b74b0167dee7d33b43ecbda8c48251cb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_22e334de-e05e-58a4-a382-d478bd0810e7/22e334de-e05e-58a4-a382-d478bd0810e7_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2502919,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img75/13/75130f334152394286ffdc88cd95c101/pa/GP63449_1f9f6b2420fc74c8d859c0d1c787ed31.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_22e334de-e05e-58a4-a382-d478bd0810e7/22e334de-e05e-58a4-a382-d478bd0810e7_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3188043,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img75/13/75130f334152394286ffdc88cd95c101/pa/GP63449_3e7bc929620e0032152e1c1a3c6c7d2a.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_22e334de-e05e-58a4-a382-d478bd0810e7/22e334de-e05e-58a4-a382-d478bd0810e7_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82488,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img75/13/75130f334152394286ffdc88cd95c101/pa/GP63449_6e1df841363730921b5047bba0c31e7b.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2013-11-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Mitsubishi Outlander 2.0 PHEV PHEV Instyle 4WD',
 'transmission': 'automatic',
 'trim': 'PHEV Instyle 4WD',
 'year': 2013}
2026-03-27 12:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GP63449%27 HTTP/1.1" 200 None
2026-03-27 12:10:47 [auto1.nl] INFO: Saving data for GP63449: {'created_time': 1774613447.070463, 'last_price_update_time': 1774613447.070475, 'auction_closing_time': 1774716050.0}
2026-03-27 12:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='GP63449') HTTP/1.1" 204 0
2026-03-27 12:10:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img99/ee/99eeba41ad1fffb1e6ccb0d7f8aee590/pa/GN83420_7c9adbfcce91f7508da47b62896caa78.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:10:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img99/ee/99eeba41ad1fffb1e6ccb0d7f8aee590/pa/GN83420_b99fb0855f418f86eab3fdabfb97202b.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcb%252Ffc%252Fcbfc9ae35f44f6834a7cc90d595d5606%252Fpa%252FFC64695_48d29f3ce062f61699b364886830be6c.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:10:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/fc/cbfc9ae35f44f6834a7cc90d595d5606/pa/FC64695_48d29f3ce062f61699b364886830be6c.jpg not downloaded yet
2026-03-27 12:10:47 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 12:10:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:10:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7d002d1910>
2026-03-27 12:10:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:10:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:10:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:10:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_02ae6fc4-df0c-537e-bfeb-79779142b37c/02ae6fc4-df0c-537e-bfeb-79779142b37c_image_3.jpg HTTP/1.1" 201 0
2026-03-27 12:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg0f%252Fc7%252F0fc7f4b96d6c761f832997fbab669e9c%252Fpa%252FSY53039_9be766df4b88efe8f7a45219466175ec.jpg') HTTP/1.1" 204 0
2026-03-27 12:10:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img0f/c7/0fc7f4b96d6c761f832997fbab669e9c/pa/SY53039_9be766df4b88efe8f7a45219466175ec.jpg saved to cache
2026-03-27 12:10:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 02ae6fc4-df0c-537e-bfeb-79779142b37c
2026-03-27 12:10:47 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 02ae6fc4-df0c-537e-bfeb-79779142b37c, skipping ID generation
2026-03-27 12:10:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 02ae6fc4-df0c-537e-bfeb-79779142b37c with scrape type 1
2026-03-27 12:10:47 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 02ae6fc4-df0c-537e-bfeb-79779142b37c sending to next pipeline
2026-03-27 12:10:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 02ae6fc4-df0c-537e-bfeb-79779142b37c, identifier: SY53039
2026-03-27 12:10:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img99/ee/99eeba41ad1fffb1e6ccb0d7f8aee590/pa/GN83420_4c62f4d9cf26142466d9b37fd656b5a5.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:10:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 02ae6fc4-df0c-537e-bfeb-79779142b37c with identifier: SY53039
2026-03-27 12:10:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 02ae6fc4-df0c-537e-bfeb-79779142b37c with identifier: SY53039
2026-03-27 12:10:47 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 02ae6fc4-df0c-537e-bfeb-79779142b37c with identifier: SY53039 to the API
2026-03-27 12:10:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 12:10:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 12:10:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img0f/c7/0fc7f4b96d6c761f832997fbab669e9c/pa/SY53039_9be766df4b88efe8f7a45219466175ec.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 6',
 'engine': '1.5L',
 'engine_horse_power': 95,
 'expiration_date': '2026-03-28T16:26:52Z',
 'fuel_type': 'diesel',
 'id': '02ae6fc4-df0c-537e-bfeb-79779142b37c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'VDL86G',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SY53039',
 'listing': 'auction',
 'location': 'NL, Den Bosch',
 'make': 'Nissan',
 'model': 'NV250',
 'odometer': 190282,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_02ae6fc4-df0c-537e-bfeb-79779142b37c/02ae6fc4-df0c-537e-bfeb-79779142b37c_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2682134,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img0f/c7/0fc7f4b96d6c761f832997fbab669e9c/pa/SY53039_c97caf558b04617c8d3851a9c42876c3.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_02ae6fc4-df0c-537e-bfeb-79779142b37c/02ae6fc4-df0c-537e-bfeb-79779142b37c_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66924,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0f/c7/0fc7f4b96d6c761f832997fbab669e9c/pa/SY53039_801170b5b882c638ddc93f1cc2fa6d94.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_02ae6fc4-df0c-537e-bfeb-79779142b37c/02ae6fc4-df0c-537e-bfeb-79779142b37c_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61431,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0f/c7/0fc7f4b96d6c761f832997fbab669e9c/pa/SY53039_a1d4704d3b1d573cd736e156dc307656.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_02ae6fc4-df0c-537e-bfeb-79779142b37c/02ae6fc4-df0c-537e-bfeb-79779142b37c_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2605878,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img0f/c7/0fc7f4b96d6c761f832997fbab669e9c/pa/SY53039_9be766df4b88efe8f7a45219466175ec.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_02ae6fc4-df0c-537e-bfeb-79779142b37c/02ae6fc4-df0c-537e-bfeb-79779142b37c_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58989,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0f/c7/0fc7f4b96d6c761f832997fbab669e9c/pa/SY53039_d08462e242ac494ddba2f8dcb360d63e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_02ae6fc4-df0c-537e-bfeb-79779142b37c/02ae6fc4-df0c-537e-bfeb-79779142b37c_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2579062,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img0f/c7/0fc7f4b96d6c761f832997fbab669e9c/pa/SY53039_2cbf6d4e3f5f9889abd3aa92a1e305b4.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_02ae6fc4-df0c-537e-bfeb-79779142b37c/02ae6fc4-df0c-537e-bfeb-79779142b37c_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 54991,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0f/c7/0fc7f4b96d6c761f832997fbab669e9c/pa/SY53039_931c575baed52dc47c74545223a5e8b5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_02ae6fc4-df0c-537e-bfeb-79779142b37c/02ae6fc4-df0c-537e-bfeb-79779142b37c_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72384,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0f/c7/0fc7f4b96d6c761f832997fbab669e9c/pa/SY53039_a2a33313d92874bad438b0d6a0302234.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_02ae6fc4-df0c-537e-bfeb-79779142b37c/02ae6fc4-df0c-537e-bfeb-79779142b37c_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67566,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0f/c7/0fc7f4b96d6c761f832997fbab669e9c/pa/SY53039_2596e41c88c0d83fa63003c8bc5842f8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_02ae6fc4-df0c-537e-bfeb-79779142b37c/02ae6fc4-df0c-537e-bfeb-79779142b37c_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75355,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img0f/c7/0fc7f4b96d6c761f832997fbab669e9c/pa/SY53039_5e20e69232f7d467b35c97b1297af140.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-11-25',
 'seats_number': 3,
 'seller_name': None,
 'title': 'Nissan NV250 1.5 dCi L1H1 2,0t Comfort',
 'transmission': 'manual',
 'trim': 'L1H1 2,0t Comfort',
 'year': 2019}
2026-03-27 12:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SY53039%27 HTTP/1.1" 200 None
2026-03-27 12:10:47 [auto1.nl] INFO: Saving data for SY53039: {'created_time': 1774613447.733057, 'last_price_update_time': 1774613447.733071, 'auction_closing_time': 1774715212.0}
2026-03-27 12:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='SY53039') HTTP/1.1" 204 0
2026-03-27 12:10:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img99/ee/99eeba41ad1fffb1e6ccb0d7f8aee590/pa/GN83420_eafe96afa782ae695d1fd8df204dbe1c.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcb%252Ffc%252Fcbfc9ae35f44f6834a7cc90d595d5606%252Fpa%252FFC64695_e3f29c6233f576548023ce3eaae36f84.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:10:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/fc/cbfc9ae35f44f6834a7cc90d595d5606/pa/FC64695_e3f29c6233f576548023ce3eaae36f84.jpg not downloaded yet
2026-03-27 12:10:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 12:10:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:10:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7cfe0ca590>
2026-03-27 12:10:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:10:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:10:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:10:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_49715ebb-1a83-5042-b7d1-86a59d60b4e0/49715ebb-1a83-5042-b7d1-86a59d60b4e0_image_7.jpg HTTP/1.1" 201 0
2026-03-27 12:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252Fee%252F99eeba41ad1fffb1e6ccb0d7f8aee590%252Fpa%252FGN83420_a07e5d2484c55a8f67cc124705ef64b0.jpg') HTTP/1.1" 204 0
2026-03-27 12:10:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/ee/99eeba41ad1fffb1e6ccb0d7f8aee590/pa/GN83420_a07e5d2484c55a8f67cc124705ef64b0.jpg saved to cache
2026-03-27 12:10:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 49715ebb-1a83-5042-b7d1-86a59d60b4e0
2026-03-27 12:10:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:10:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7cfcdc5c10>
2026-03-27 12:10:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:10:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:10:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:10:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_49715ebb-1a83-5042-b7d1-86a59d60b4e0/49715ebb-1a83-5042-b7d1-86a59d60b4e0_image_1.jpg HTTP/1.1" 201 0
2026-03-27 12:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252Fee%252F99eeba41ad1fffb1e6ccb0d7f8aee590%252Fpa%252FGN83420_7c9adbfcce91f7508da47b62896caa78.jpg') HTTP/1.1" 204 0
2026-03-27 12:10:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/ee/99eeba41ad1fffb1e6ccb0d7f8aee590/pa/GN83420_7c9adbfcce91f7508da47b62896caa78.jpg saved to cache
2026-03-27 12:10:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 49715ebb-1a83-5042-b7d1-86a59d60b4e0
2026-03-27 12:10:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:10:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7cfe0f8f10>
2026-03-27 12:10:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:10:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:10:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:10:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_49715ebb-1a83-5042-b7d1-86a59d60b4e0/49715ebb-1a83-5042-b7d1-86a59d60b4e0_image_2.jpg HTTP/1.1" 201 0
2026-03-27 12:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252Fee%252F99eeba41ad1fffb1e6ccb0d7f8aee590%252Fpa%252FGN83420_b99fb0855f418f86eab3fdabfb97202b.jpg') HTTP/1.1" 204 0
2026-03-27 12:10:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/ee/99eeba41ad1fffb1e6ccb0d7f8aee590/pa/GN83420_b99fb0855f418f86eab3fdabfb97202b.jpg saved to cache
2026-03-27 12:10:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 49715ebb-1a83-5042-b7d1-86a59d60b4e0
2026-03-27 12:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcb%252Ffc%252Fcbfc9ae35f44f6834a7cc90d595d5606%252Fpa%252FFC64695_aa71c918a358f2aa15f1ab88c930bb59.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:10:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/fc/cbfc9ae35f44f6834a7cc90d595d5606/pa/FC64695_aa71c918a358f2aa15f1ab88c930bb59.jpg not downloaded yet
2026-03-27 12:10:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 12:10:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 12:10:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:10:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7cfccf0750>
2026-03-27 12:10:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:10:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:10:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:10:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_49715ebb-1a83-5042-b7d1-86a59d60b4e0/49715ebb-1a83-5042-b7d1-86a59d60b4e0_image_9.jpg HTTP/1.1" 201 0
2026-03-27 12:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252Fee%252F99eeba41ad1fffb1e6ccb0d7f8aee590%252Fpa%252FGN83420_4c62f4d9cf26142466d9b37fd656b5a5.jpg') HTTP/1.1" 204 0
2026-03-27 12:10:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/ee/99eeba41ad1fffb1e6ccb0d7f8aee590/pa/GN83420_4c62f4d9cf26142466d9b37fd656b5a5.jpg saved to cache
2026-03-27 12:10:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 49715ebb-1a83-5042-b7d1-86a59d60b4e0
2026-03-27 12:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgcb%252Ffc%252Fcbfc9ae35f44f6834a7cc90d595d5606%252Fpa%252FFC64695_386f73b971d40e50fe5de7ca35ec2cb3.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:10:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/fc/cbfc9ae35f44f6834a7cc90d595d5606/pa/FC64695_386f73b971d40e50fe5de7ca35ec2cb3.jpg not downloaded yet
2026-03-27 12:10:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:10:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7cfccf3790>
2026-03-27 12:10:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:10:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:10:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:10:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_49715ebb-1a83-5042-b7d1-86a59d60b4e0/49715ebb-1a83-5042-b7d1-86a59d60b4e0_image_5.jpg HTTP/1.1" 201 0
2026-03-27 12:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252Fee%252F99eeba41ad1fffb1e6ccb0d7f8aee590%252Fpa%252FGN83420_eafe96afa782ae695d1fd8df204dbe1c.jpg') HTTP/1.1" 204 0
2026-03-27 12:10:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/ee/99eeba41ad1fffb1e6ccb0d7f8aee590/pa/GN83420_eafe96afa782ae695d1fd8df204dbe1c.jpg saved to cache
2026-03-27 12:10:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 49715ebb-1a83-5042-b7d1-86a59d60b4e0
2026-03-27 12:10:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcb/fc/cbfc9ae35f44f6834a7cc90d595d5606/pa/FC64695_279478edc7b4da1ddac3d4aabe6e6c88.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:10:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img99/ee/99eeba41ad1fffb1e6ccb0d7f8aee590/pa/GN83420_36aa5211913e6d5eb988e9d2fd76e1f7.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:10:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img99/ee/99eeba41ad1fffb1e6ccb0d7f8aee590/pa/GN83420_73bee539d44078d956961f11c8211de6.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:10:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img99/ee/99eeba41ad1fffb1e6ccb0d7f8aee590/pa/GN83420_d063c735f78e8fd09f2937152d85793a.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:10:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img99/ee/99eeba41ad1fffb1e6ccb0d7f8aee590/pa/GN83420_dcf9a95ecd755420395401fd4ff7c0c9.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:10:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcb/fc/cbfc9ae35f44f6834a7cc90d595d5606/pa/FC64695_e3f29c6233f576548023ce3eaae36f84.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:10:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ZZ76935/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 12:10:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcb/fc/cbfc9ae35f44f6834a7cc90d595d5606/pa/FC64695_48d29f3ce062f61699b364886830be6c.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:10:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcb/fc/cbfc9ae35f44f6834a7cc90d595d5606/pa/FC64695_aa71c918a358f2aa15f1ab88c930bb59.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:10:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:10:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7cfdfaab50>
2026-03-27 12:10:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:10:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:10:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:10:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b440c16f-9729-50c4-b006-0c0325ae9f89/b440c16f-9729-50c4-b006-0c0325ae9f89_image_0.jpg HTTP/1.1" 201 0
2026-03-27 12:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcb%252Ffc%252Fcbfc9ae35f44f6834a7cc90d595d5606%252Fpa%252FFC64695_279478edc7b4da1ddac3d4aabe6e6c88.jpg') HTTP/1.1" 204 0
2026-03-27 12:10:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/fc/cbfc9ae35f44f6834a7cc90d595d5606/pa/FC64695_279478edc7b4da1ddac3d4aabe6e6c88.jpg saved to cache
2026-03-27 12:10:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b440c16f-9729-50c4-b006-0c0325ae9f89
2026-03-27 12:10:48 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 12:10:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:10:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7cfe0cce10>
2026-03-27 12:10:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:10:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:10:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:10:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_49715ebb-1a83-5042-b7d1-86a59d60b4e0/49715ebb-1a83-5042-b7d1-86a59d60b4e0_image_3.jpg HTTP/1.1" 201 0
2026-03-27 12:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252Fee%252F99eeba41ad1fffb1e6ccb0d7f8aee590%252Fpa%252FGN83420_36aa5211913e6d5eb988e9d2fd76e1f7.jpg') HTTP/1.1" 204 0
2026-03-27 12:10:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/ee/99eeba41ad1fffb1e6ccb0d7f8aee590/pa/GN83420_36aa5211913e6d5eb988e9d2fd76e1f7.jpg saved to cache
2026-03-27 12:10:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 49715ebb-1a83-5042-b7d1-86a59d60b4e0
2026-03-27 12:10:48 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 12:10:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:10:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7cfce3a110>
2026-03-27 12:10:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:10:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:10:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:10:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_49715ebb-1a83-5042-b7d1-86a59d60b4e0/49715ebb-1a83-5042-b7d1-86a59d60b4e0_image_4.jpg HTTP/1.1" 201 0
2026-03-27 12:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252Fee%252F99eeba41ad1fffb1e6ccb0d7f8aee590%252Fpa%252FGN83420_73bee539d44078d956961f11c8211de6.jpg') HTTP/1.1" 204 0
2026-03-27 12:10:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/ee/99eeba41ad1fffb1e6ccb0d7f8aee590/pa/GN83420_73bee539d44078d956961f11c8211de6.jpg saved to cache
2026-03-27 12:10:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 49715ebb-1a83-5042-b7d1-86a59d60b4e0
2026-03-27 12:10:48 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 12:10:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:10:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7cfdfb8910>
2026-03-27 12:10:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:10:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:10:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:10:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_49715ebb-1a83-5042-b7d1-86a59d60b4e0/49715ebb-1a83-5042-b7d1-86a59d60b4e0_image_6.jpg HTTP/1.1" 201 0
2026-03-27 12:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252Fee%252F99eeba41ad1fffb1e6ccb0d7f8aee590%252Fpa%252FGN83420_d063c735f78e8fd09f2937152d85793a.jpg') HTTP/1.1" 204 0
2026-03-27 12:10:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/ee/99eeba41ad1fffb1e6ccb0d7f8aee590/pa/GN83420_d063c735f78e8fd09f2937152d85793a.jpg saved to cache
2026-03-27 12:10:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 49715ebb-1a83-5042-b7d1-86a59d60b4e0
2026-03-27 12:10:48 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 12:10:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:10:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7cfe051950>
2026-03-27 12:10:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:10:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:10:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:10:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_49715ebb-1a83-5042-b7d1-86a59d60b4e0/49715ebb-1a83-5042-b7d1-86a59d60b4e0_image_8.jpg HTTP/1.1" 201 0
2026-03-27 12:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg99%252Fee%252F99eeba41ad1fffb1e6ccb0d7f8aee590%252Fpa%252FGN83420_dcf9a95ecd755420395401fd4ff7c0c9.jpg') HTTP/1.1" 204 0
2026-03-27 12:10:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img99/ee/99eeba41ad1fffb1e6ccb0d7f8aee590/pa/GN83420_dcf9a95ecd755420395401fd4ff7c0c9.jpg saved to cache
2026-03-27 12:10:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 49715ebb-1a83-5042-b7d1-86a59d60b4e0
2026-03-27 12:10:48 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 49715ebb-1a83-5042-b7d1-86a59d60b4e0, skipping ID generation
2026-03-27 12:10:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 49715ebb-1a83-5042-b7d1-86a59d60b4e0 with scrape type 1
2026-03-27 12:10:48 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 49715ebb-1a83-5042-b7d1-86a59d60b4e0 sending to next pipeline
2026-03-27 12:10:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 49715ebb-1a83-5042-b7d1-86a59d60b4e0, identifier: GN83420
2026-03-27 12:10:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 49715ebb-1a83-5042-b7d1-86a59d60b4e0 with identifier: GN83420
2026-03-27 12:10:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 49715ebb-1a83-5042-b7d1-86a59d60b4e0 with identifier: GN83420
2026-03-27 12:10:49 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 49715ebb-1a83-5042-b7d1-86a59d60b4e0 with identifier: GN83420 to the API
2026-03-27 12:10:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 12:10:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 12:10:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img99/ee/99eeba41ad1fffb1e6ccb0d7f8aee590/pa/GN83420_dcf9a95ecd755420395401fd4ff7c0c9.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 141,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6A',
 'engine': '1.0L',
 'engine_horse_power': 115,
 'expiration_date': '2026-03-28T16:52:55Z',
 'fuel_type': 'petrol',
 'id': '49715ebb-1a83-5042-b7d1-86a59d60b4e0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'H010LN',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GN83420',
 'listing': 'auction',
 'location': 'NL, Tradein',
 'make': 'Volkswagen',
 'model': 'T-Roc',
 'odometer': 112755,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 16,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_49715ebb-1a83-5042-b7d1-86a59d60b4e0/49715ebb-1a83-5042-b7d1-86a59d60b4e0_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 108001,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img99/ee/99eeba41ad1fffb1e6ccb0d7f8aee590/pa/GN83420_1a1a67fdd52c4503712d4617f89daa70.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_49715ebb-1a83-5042-b7d1-86a59d60b4e0/49715ebb-1a83-5042-b7d1-86a59d60b4e0_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 96272,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img99/ee/99eeba41ad1fffb1e6ccb0d7f8aee590/pa/GN83420_7c9adbfcce91f7508da47b62896caa78.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_49715ebb-1a83-5042-b7d1-86a59d60b4e0/49715ebb-1a83-5042-b7d1-86a59d60b4e0_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 111262,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img99/ee/99eeba41ad1fffb1e6ccb0d7f8aee590/pa/GN83420_b99fb0855f418f86eab3fdabfb97202b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_49715ebb-1a83-5042-b7d1-86a59d60b4e0/49715ebb-1a83-5042-b7d1-86a59d60b4e0_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2770601,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img99/ee/99eeba41ad1fffb1e6ccb0d7f8aee590/pa/GN83420_36aa5211913e6d5eb988e9d2fd76e1f7.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_49715ebb-1a83-5042-b7d1-86a59d60b4e0/49715ebb-1a83-5042-b7d1-86a59d60b4e0_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3596968,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img99/ee/99eeba41ad1fffb1e6ccb0d7f8aee590/pa/GN83420_73bee539d44078d956961f11c8211de6.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_49715ebb-1a83-5042-b7d1-86a59d60b4e0/49715ebb-1a83-5042-b7d1-86a59d60b4e0_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 125490,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img99/ee/99eeba41ad1fffb1e6ccb0d7f8aee590/pa/GN83420_eafe96afa782ae695d1fd8df204dbe1c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_49715ebb-1a83-5042-b7d1-86a59d60b4e0/49715ebb-1a83-5042-b7d1-86a59d60b4e0_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3126957,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img99/ee/99eeba41ad1fffb1e6ccb0d7f8aee590/pa/GN83420_d063c735f78e8fd09f2937152d85793a.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_49715ebb-1a83-5042-b7d1-86a59d60b4e0/49715ebb-1a83-5042-b7d1-86a59d60b4e0_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 117280,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img99/ee/99eeba41ad1fffb1e6ccb0d7f8aee590/pa/GN83420_a07e5d2484c55a8f67cc124705ef64b0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_49715ebb-1a83-5042-b7d1-86a59d60b4e0/49715ebb-1a83-5042-b7d1-86a59d60b4e0_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3411518,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img99/ee/99eeba41ad1fffb1e6ccb0d7f8aee590/pa/GN83420_dcf9a95ecd755420395401fd4ff7c0c9.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_49715ebb-1a83-5042-b7d1-86a59d60b4e0/49715ebb-1a83-5042-b7d1-86a59d60b4e0_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 103171,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img99/ee/99eeba41ad1fffb1e6ccb0d7f8aee590/pa/GN83420_4c62f4d9cf26142466d9b37fd656b5a5.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-10-14',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen T-Roc 1.0 TSI Style',
 'transmission': 'manual',
 'trim': 'Style',
 'year': 2018}
2026-03-27 12:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GN83420%27 HTTP/1.1" 200 None
2026-03-27 12:10:49 [auto1.nl] INFO: Saving data for GN83420: {'created_time': 1774613449.383712, 'last_price_update_time': 1774613449.383728, 'auction_closing_time': 1774716775.0}
2026-03-27 12:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='GN83420') HTTP/1.1" 204 0
2026-03-27 12:10:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgcb/fc/cbfc9ae35f44f6834a7cc90d595d5606/pa/FC64695_386f73b971d40e50fe5de7ca35ec2cb3.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:10:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/NY57976> (referer: https://www.auto1.com/v1/car-details-view/NY57976/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 12:10:49 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 12:10:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DZ37745> (referer: https://www.auto1.com/v1/car-details-view/DZ37745/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 12:10:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BU16200> (referer: https://www.auto1.com/v1/car-details-view/BU16200/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 12:10:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DA49617> (referer: https://www.auto1.com/v1/car-details-view/DA49617/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 12:10:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WU34213> (referer: https://www.auto1.com/v1/car-details-view/WU34213/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 12:10:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PY55457/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 12:10:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:10:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7cfdfb95d0>
2026-03-27 12:10:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:10:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:10:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:10:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b440c16f-9729-50c4-b006-0c0325ae9f89/b440c16f-9729-50c4-b006-0c0325ae9f89_image_2.jpg HTTP/1.1" 201 0
2026-03-27 12:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcb%252Ffc%252Fcbfc9ae35f44f6834a7cc90d595d5606%252Fpa%252FFC64695_e3f29c6233f576548023ce3eaae36f84.jpg') HTTP/1.1" 204 0
2026-03-27 12:10:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/fc/cbfc9ae35f44f6834a7cc90d595d5606/pa/FC64695_e3f29c6233f576548023ce3eaae36f84.jpg saved to cache
2026-03-27 12:10:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b440c16f-9729-50c4-b006-0c0325ae9f89
2026-03-27 12:10:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:10:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7cfe06ea10>
2026-03-27 12:10:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:10:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:10:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:10:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b440c16f-9729-50c4-b006-0c0325ae9f89/b440c16f-9729-50c4-b006-0c0325ae9f89_image_1.jpg HTTP/1.1" 201 0
2026-03-27 12:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcb%252Ffc%252Fcbfc9ae35f44f6834a7cc90d595d5606%252Fpa%252FFC64695_48d29f3ce062f61699b364886830be6c.jpg') HTTP/1.1" 204 0
2026-03-27 12:10:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/fc/cbfc9ae35f44f6834a7cc90d595d5606/pa/FC64695_48d29f3ce062f61699b364886830be6c.jpg saved to cache
2026-03-27 12:10:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b440c16f-9729-50c4-b006-0c0325ae9f89
2026-03-27 12:10:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:10:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7cfffe3b50>
2026-03-27 12:10:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:10:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:10:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:10:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b440c16f-9729-50c4-b006-0c0325ae9f89/b440c16f-9729-50c4-b006-0c0325ae9f89_image_3.jpg HTTP/1.1" 201 0
2026-03-27 12:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcb%252Ffc%252Fcbfc9ae35f44f6834a7cc90d595d5606%252Fpa%252FFC64695_aa71c918a358f2aa15f1ab88c930bb59.jpg') HTTP/1.1" 204 0
2026-03-27 12:10:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/fc/cbfc9ae35f44f6834a7cc90d595d5606/pa/FC64695_aa71c918a358f2aa15f1ab88c930bb59.jpg saved to cache
2026-03-27 12:10:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b440c16f-9729-50c4-b006-0c0325ae9f89
2026-03-27 12:10:49 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 12:10:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:10:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7d002cccd0>
2026-03-27 12:10:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:10:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:10:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:10:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b440c16f-9729-50c4-b006-0c0325ae9f89/b440c16f-9729-50c4-b006-0c0325ae9f89_image_4.jpg HTTP/1.1" 201 0
2026-03-27 12:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgcb%252Ffc%252Fcbfc9ae35f44f6834a7cc90d595d5606%252Fpa%252FFC64695_386f73b971d40e50fe5de7ca35ec2cb3.jpg') HTTP/1.1" 204 0
2026-03-27 12:10:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgcb/fc/cbfc9ae35f44f6834a7cc90d595d5606/pa/FC64695_386f73b971d40e50fe5de7ca35ec2cb3.jpg saved to cache
2026-03-27 12:10:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b440c16f-9729-50c4-b006-0c0325ae9f89
2026-03-27 12:10:49 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b440c16f-9729-50c4-b006-0c0325ae9f89, skipping ID generation
2026-03-27 12:10:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b440c16f-9729-50c4-b006-0c0325ae9f89 with scrape type 1
2026-03-27 12:10:49 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b440c16f-9729-50c4-b006-0c0325ae9f89 sending to next pipeline
2026-03-27 12:10:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: b440c16f-9729-50c4-b006-0c0325ae9f89, identifier: FC64695
2026-03-27 12:10:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7c40c185-843e-5d61-911e-4bee8fe9d413 with identifier: NY57976
2026-03-27 12:10:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7c40c185-843e-5d61-911e-4bee8fe9d413 with scrape type 1
2026-03-27 12:10:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 7c40c185-843e-5d61-911e-4bee8fe9d413
2026-03-27 12:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg31%252Fe9%252F31e93b4b2f1af9e4c69d29706eaf09e9%252Fpa%252FNY57976_7cc1bc16efaa698ea5fd5ad82ea1ecaa.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:10:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/e9/31e93b4b2f1af9e4c69d29706eaf09e9/pa/NY57976_7cc1bc16efaa698ea5fd5ad82ea1ecaa.jpg not downloaded yet
2026-03-27 12:10:49 [auto1.nl] INFO: Channel: 24h | Page: 3 | totalHits: 1060 | hits on page: 40
2026-03-27 12:10:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 74565cf4-5b98-5bc4-9483-e63f6ecdc4fa with identifier: DZ37745
2026-03-27 12:10:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 74565cf4-5b98-5bc4-9483-e63f6ecdc4fa with scrape type 1
2026-03-27 12:10:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 74565cf4-5b98-5bc4-9483-e63f6ecdc4fa
2026-03-27 12:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg59%252Fb2%252F59b2171a128a5cfbb010b59f256ad515%252Fpa%252FDZ37745_209594b2851df59aa50725d6a9c0a803.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:10:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/b2/59b2171a128a5cfbb010b59f256ad515/pa/DZ37745_209594b2851df59aa50725d6a9c0a803.jpg already downloaded
2026-03-27 12:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg59%252Fb2%252F59b2171a128a5cfbb010b59f256ad515%252Fpa%252FDZ37745_034a3226a588f323cb9bc061b5af665c.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:10:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/b2/59b2171a128a5cfbb010b59f256ad515/pa/DZ37745_034a3226a588f323cb9bc061b5af665c.jpg already downloaded
2026-03-27 12:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg59%252Fb2%252F59b2171a128a5cfbb010b59f256ad515%252Fpa%252FDZ37745_dcd62b6080e291218792224022f4b8bc.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:10:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/b2/59b2171a128a5cfbb010b59f256ad515/pa/DZ37745_dcd62b6080e291218792224022f4b8bc.jpg already downloaded
2026-03-27 12:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg59%252Fb2%252F59b2171a128a5cfbb010b59f256ad515%252Fpa%252FDZ37745_697e1972e934d365f5e2c47fc16ef5d2.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:10:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/b2/59b2171a128a5cfbb010b59f256ad515/pa/DZ37745_697e1972e934d365f5e2c47fc16ef5d2.jpg already downloaded
2026-03-27 12:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg59%252Fb2%252F59b2171a128a5cfbb010b59f256ad515%252Fpa%252FDZ37745_d79c94ad3f147446dcf6c49d11e4bb6c.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:10:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img59/b2/59b2171a128a5cfbb010b59f256ad515/pa/DZ37745_d79c94ad3f147446dcf6c49d11e4bb6c.jpg already downloaded
2026-03-27 12:10:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 74565cf4-5b98-5bc4-9483-e63f6ecdc4fa, identifier: DZ37745
2026-03-27 12:10:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a1d476b6-ca15-5b1b-b633-eafb1a6a0d81 with identifier: BU16200
2026-03-27 12:10:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a1d476b6-ca15-5b1b-b633-eafb1a6a0d81 with scrape type 1
2026-03-27 12:10:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a1d476b6-ca15-5b1b-b633-eafb1a6a0d81
2026-03-27 12:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252F4f%252F474f7861a373700e675deea527d017ce%252Fpa%252FBU16200_75706c46552ef61a3763de9f2ccefe68.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:10:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/4f/474f7861a373700e675deea527d017ce/pa/BU16200_75706c46552ef61a3763de9f2ccefe68.jpg not downloaded yet
2026-03-27 12:10:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 51b97771-700f-5d91-a60b-59b108a49e15 with identifier: DA49617
2026-03-27 12:10:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 51b97771-700f-5d91-a60b-59b108a49e15 with scrape type 1
2026-03-27 12:10:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 51b97771-700f-5d91-a60b-59b108a49e15
2026-03-27 12:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F34%252Fae344a715587a9cce542943901610cdf%252Fpa%252FDA49617_0e3c3d4b143ac940b154af1430b4d0d9.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:10:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/34/ae344a715587a9cce542943901610cdf/pa/DA49617_0e3c3d4b143ac940b154af1430b4d0d9.jpg not downloaded yet
2026-03-27 12:10:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 77737d54-e208-58bd-b23d-d89e6e2f3656 with identifier: WU34213
2026-03-27 12:10:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 77737d54-e208-58bd-b23d-d89e6e2f3656 with scrape type 1
2026-03-27 12:10:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 77737d54-e208-58bd-b23d-d89e6e2f3656
2026-03-27 12:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg68%252Fc4%252F68c4f8ed3c358c3ecbaf57f5db9f31fa%252Fpa%252FWU34213_c4774910cec564b255d564961aedf651.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:10:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/c4/68c4f8ed3c358c3ecbaf57f5db9f31fa/pa/WU34213_c4774910cec564b255d564961aedf651.jpg not downloaded yet
2026-03-27 12:10:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: b440c16f-9729-50c4-b006-0c0325ae9f89 with identifier: FC64695
2026-03-27 12:10:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: b440c16f-9729-50c4-b006-0c0325ae9f89 with identifier: FC64695
2026-03-27 12:10:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: b440c16f-9729-50c4-b006-0c0325ae9f89 with identifier: FC64695 to the API
2026-03-27 12:10:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 12:10:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 12:10:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgcb/fc/cbfc9ae35f44f6834a7cc90d595d5606/pa/FC64695_386f73b971d40e50fe5de7ca35ec2cb3.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 158,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 3,
 'emission_standard': 'EURO 4',
 'engine': '1.6L',
 'engine_horse_power': 90,
 'expiration_date': '2026-03-28T16:11:28Z',
 'fuel_type': 'petrol',
 'id': 'b440c16f-9729-50c4-b006-0c0325ae9f89',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'TV404X',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FC64695',
 'listing': 'auction',
 'location': 'NL, Haarlem',
 'make': 'MINI',
 'model': 'MINI',
 'odometer': 185857,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b440c16f-9729-50c4-b006-0c0325ae9f89/b440c16f-9729-50c4-b006-0c0325ae9f89_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72436,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcb/fc/cbfc9ae35f44f6834a7cc90d595d5606/pa/FC64695_279478edc7b4da1ddac3d4aabe6e6c88.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b440c16f-9729-50c4-b006-0c0325ae9f89/b440c16f-9729-50c4-b006-0c0325ae9f89_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79249,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcb/fc/cbfc9ae35f44f6834a7cc90d595d5606/pa/FC64695_48d29f3ce062f61699b364886830be6c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b440c16f-9729-50c4-b006-0c0325ae9f89/b440c16f-9729-50c4-b006-0c0325ae9f89_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73304,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcb/fc/cbfc9ae35f44f6834a7cc90d595d5606/pa/FC64695_e3f29c6233f576548023ce3eaae36f84.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b440c16f-9729-50c4-b006-0c0325ae9f89/b440c16f-9729-50c4-b006-0c0325ae9f89_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 55797,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcb/fc/cbfc9ae35f44f6834a7cc90d595d5606/pa/FC64695_aa71c918a358f2aa15f1ab88c930bb59.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b440c16f-9729-50c4-b006-0c0325ae9f89/b440c16f-9729-50c4-b006-0c0325ae9f89_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66231,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgcb/fc/cbfc9ae35f44f6834a7cc90d595d5606/pa/FC64695_386f73b971d40e50fe5de7ca35ec2cb3.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2003-03-16',
 'seats_number': 4,
 'seller_name': None,
 'title': 'MINI One',
 'transmission': 'manual',
 'trim': '',
 'year': 2003}
2026-03-27 12:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FC64695%27 HTTP/1.1" 200 None
2026-03-27 12:10:50 [auto1.nl] INFO: Saving data for FC64695: {'created_time': 1774613450.447302, 'last_price_update_time': 1774613450.447314, 'auction_closing_time': 1774714288.0}
2026-03-27 12:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='FC64695') HTTP/1.1" 204 0
2026-03-27 12:10:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 74565cf4-5b98-5bc4-9483-e63f6ecdc4fa with identifier: DZ37745
2026-03-27 12:10:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 74565cf4-5b98-5bc4-9483-e63f6ecdc4fa with identifier: DZ37745
2026-03-27 12:10:50 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 74565cf4-5b98-5bc4-9483-e63f6ecdc4fa with identifier: DZ37745 to the API
2026-03-27 12:10:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 12:10:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 12:10:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/DZ37745>
{'auction_title': '',
 'c_o_2_emission_value': 139,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '1.4L',
 'engine_horse_power': 100,
 'expiration_date': '2026-03-28T16:31:20Z',
 'fuel_type': 'petrol',
 'id': '74565cf4-5b98-5bc4-9483-e63f6ecdc4fa',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': '06SKJ9',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DZ37745',
 'listing': 'auction',
 'location': 'NL, Oosterhout',
 'make': 'Opel',
 'model': 'Astra',
 'odometer': 190764,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 5,
 'photo_urls': ['https://img-pa.auto1.com/img59/b2/59b2171a128a5cfbb010b59f256ad515/pa/DZ37745_209594b2851df59aa50725d6a9c0a803.jpg',
                'https://img-pa.auto1.com/img59/b2/59b2171a128a5cfbb010b59f256ad515/pa/DZ37745_034a3226a588f323cb9bc061b5af665c.jpg',
                'https://img-pa.auto1.com/img59/b2/59b2171a128a5cfbb010b59f256ad515/pa/DZ37745_dcd62b6080e291218792224022f4b8bc.jpg',
                'https://img-pa.auto1.com/img59/b2/59b2171a128a5cfbb010b59f256ad515/pa/DZ37745_697e1972e934d365f5e2c47fc16ef5d2.jpg',
                'https://img-pa.auto1.com/img59/b2/59b2171a128a5cfbb010b59f256ad515/pa/DZ37745_d79c94ad3f147446dcf6c49d11e4bb6c.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_74565cf4-5b98-5bc4-9483-e63f6ecdc4fa/74565cf4-5b98-5bc4-9483-e63f6ecdc4fa_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86536,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img59/b2/59b2171a128a5cfbb010b59f256ad515/pa/DZ37745_209594b2851df59aa50725d6a9c0a803.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_74565cf4-5b98-5bc4-9483-e63f6ecdc4fa/74565cf4-5b98-5bc4-9483-e63f6ecdc4fa_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89202,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img59/b2/59b2171a128a5cfbb010b59f256ad515/pa/DZ37745_034a3226a588f323cb9bc061b5af665c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_74565cf4-5b98-5bc4-9483-e63f6ecdc4fa/74565cf4-5b98-5bc4-9483-e63f6ecdc4fa_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74700,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img59/b2/59b2171a128a5cfbb010b59f256ad515/pa/DZ37745_dcd62b6080e291218792224022f4b8bc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_74565cf4-5b98-5bc4-9483-e63f6ecdc4fa/74565cf4-5b98-5bc4-9483-e63f6ecdc4fa_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74336,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img59/b2/59b2171a128a5cfbb010b59f256ad515/pa/DZ37745_697e1972e934d365f5e2c47fc16ef5d2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_74565cf4-5b98-5bc4-9483-e63f6ecdc4fa/74565cf4-5b98-5bc4-9483-e63f6ecdc4fa_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80699,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img59/b2/59b2171a128a5cfbb010b59f256ad515/pa/DZ37745_d79c94ad3f147446dcf6c49d11e4bb6c.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2011-10-16',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Opel Astra 1.4 Design Edition',
 'transmission': 'manual',
 'trim': 'Design Edition',
 'year': 2011}
2026-03-27 12:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DZ37745%27 HTTP/1.1" 200 None
2026-03-27 12:10:51 [auto1.nl] INFO: Saving data for DZ37745: {'created_time': 1774613451.079042, 'last_price_update_time': 1774613451.079055, 'auction_closing_time': 1774715480.0}
2026-03-27 12:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='DZ37745') HTTP/1.1" 204 0
2026-03-27 12:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg31%252Fe9%252F31e93b4b2f1af9e4c69d29706eaf09e9%252Fpa%252FNY57976_ebe98eda2cdb98d37056036f7d4009a3.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:10:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/e9/31e93b4b2f1af9e4c69d29706eaf09e9/pa/NY57976_ebe98eda2cdb98d37056036f7d4009a3.jpg not downloaded yet
2026-03-27 12:10:51 [auto1.nl] INFO: Found listing with ID: WK29789
2026-03-27 12:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WK29789%27 HTTP/1.1" 200 None
2026-03-27 12:10:51 [auto1.nl] INFO: Scrape type for WK29789: 2
2026-03-27 12:10:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6817a3df-020f-50e7-bb25-2b9bd824fefb with identifier: WK29789
2026-03-27 12:10:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6817a3df-020f-50e7-bb25-2b9bd824fefb with scrape type 2
2026-03-27 12:10:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6817a3df-020f-50e7-bb25-2b9bd824fefb with scrape type 2
2026-03-27 12:10:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 6817a3df-020f-50e7-bb25-2b9bd824fefb, identifier: WK29789
2026-03-27 12:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252F4f%252F474f7861a373700e675deea527d017ce%252Fpa%252FBU16200_af99ff4c908143fd4c48b4f98ff4a394.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:10:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/4f/474f7861a373700e675deea527d017ce/pa/BU16200_af99ff4c908143fd4c48b4f98ff4a394.jpg not downloaded yet
2026-03-27 12:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F34%252Fae344a715587a9cce542943901610cdf%252Fpa%252FDA49617_d2196b5dd48731d600b684ac659836b2.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:10:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/34/ae344a715587a9cce542943901610cdf/pa/DA49617_d2196b5dd48731d600b684ac659836b2.jpg not downloaded yet
2026-03-27 12:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg68%252Fc4%252F68c4f8ed3c358c3ecbaf57f5db9f31fa%252Fpa%252FWU34213_3ffe179694ee36cd9ee364d8ef4bd561.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:10:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/c4/68c4f8ed3c358c3ecbaf57f5db9f31fa/pa/WU34213_3ffe179694ee36cd9ee364d8ef4bd561.jpg not downloaded yet
2026-03-27 12:10:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 6817a3df-020f-50e7-bb25-2b9bd824fefb with identifier: WK29789
2026-03-27 12:10:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 6817a3df-020f-50e7-bb25-2b9bd824fefb with identifier: WK29789
2026-03-27 12:10:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 6817a3df-020f-50e7-bb25-2b9bd824fefb with identifier: WK29789 to the API
2026-03-27 12:10:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 12:10:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 12:10:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-28T16:29:40Z',
 'fuel_type': 'petrol',
 'id': '6817a3df-020f-50e7-bb25-2b9bd824fefb',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WK29789',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII Sportsvan',
 'odometer': 143827,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-02-25',
 'seller_name': None,
 'title': 'Volkswagen Golf VII Sportsvan 1.0 TSI Comfortline',
 'transmission': 'automatic',
 'trim': 'Comfortline',
 'year': 2019}
2026-03-27 12:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WK29789%27 HTTP/1.1" 200 None
2026-03-27 12:10:51 [auto1.nl] INFO: Saving data for WK29789: {'auction_closing_time': 1774715380.0, 'created_time': 1773688299.871507, 'last_price_update_time': 1774613451.624829}
2026-03-27 12:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='WK29789') HTTP/1.1" 204 0
2026-03-27 12:10:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 12:10:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 12:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg31%252Fe9%252F31e93b4b2f1af9e4c69d29706eaf09e9%252Fpa%252FNY57976_582c3ed868a655c309c83b92a22d358c.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:10:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/e9/31e93b4b2f1af9e4c69d29706eaf09e9/pa/NY57976_582c3ed868a655c309c83b92a22d358c.jpg not downloaded yet
2026-03-27 12:10:51 [auto1.nl] INFO: Found listing with ID: UB57166
2026-03-27 12:10:51 [auto1.nl] INFO: Found listing with ID: YU82988
2026-03-27 12:10:51 [auto1.nl] INFO: Found listing with ID: WD65994
2026-03-27 12:10:51 [auto1.nl] INFO: Found listing with ID: GS47094
2026-03-27 12:10:51 [auto1.nl] INFO: Found listing with ID: LH66044
2026-03-27 12:10:51 [auto1.nl] INFO: Found listing with ID: XA85497
2026-03-27 12:10:51 [auto1.nl] INFO: Found listing with ID: CG77801
2026-03-27 12:10:51 [auto1.nl] INFO: Found listing with ID: YH72796
2026-03-27 12:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YH72796%27 HTTP/1.1" 200 None
2026-03-27 12:10:51 [auto1.nl] INFO: Scrape type for YH72796: 2
2026-03-27 12:10:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 57d93af0-67d8-55f9-ae0a-201b49f43387 with identifier: YH72796
2026-03-27 12:10:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 57d93af0-67d8-55f9-ae0a-201b49f43387 with scrape type 2
2026-03-27 12:10:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 57d93af0-67d8-55f9-ae0a-201b49f43387 with scrape type 2
2026-03-27 12:10:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 57d93af0-67d8-55f9-ae0a-201b49f43387, identifier: YH72796
2026-03-27 12:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252F4f%252F474f7861a373700e675deea527d017ce%252Fpa%252FBU16200_df499e026ee5905574e17356299b5e29.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:10:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/4f/474f7861a373700e675deea527d017ce/pa/BU16200_df499e026ee5905574e17356299b5e29.jpg not downloaded yet
2026-03-27 12:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F34%252Fae344a715587a9cce542943901610cdf%252Fpa%252FDA49617_9d5b84ec1c1a8ee411b7b720554c9f35.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:10:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/34/ae344a715587a9cce542943901610cdf/pa/DA49617_9d5b84ec1c1a8ee411b7b720554c9f35.jpg not downloaded yet
2026-03-27 12:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg68%252Fc4%252F68c4f8ed3c358c3ecbaf57f5db9f31fa%252Fpa%252FWU34213_8cddec371edcdd5398494e52ebc998f6.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:10:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/c4/68c4f8ed3c358c3ecbaf57f5db9f31fa/pa/WU34213_8cddec371edcdd5398494e52ebc998f6.jpg not downloaded yet
2026-03-27 12:10:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 57d93af0-67d8-55f9-ae0a-201b49f43387 with identifier: YH72796
2026-03-27 12:10:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 57d93af0-67d8-55f9-ae0a-201b49f43387 with identifier: YH72796
2026-03-27 12:10:51 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 57d93af0-67d8-55f9-ae0a-201b49f43387 with identifier: YH72796 to the API
2026-03-27 12:10:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 12:10:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 12:10:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 313,
 'expiration_date': '2026-03-28T16:21:33Z',
 'fuel_type': 'hybrid',
 'id': '57d93af0-67d8-55f9-ae0a-201b49f43387',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YH72796',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X5',
 'odometer': 208636,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-01-30',
 'seller_name': None,
 'title': 'BMW X5 xDrive 40e Lounge Plus',
 'transmission': 'automatic',
 'trim': 'Lounge Plus',
 'year': 2017}
2026-03-27 12:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YH72796%27 HTTP/1.1" 200 None
2026-03-27 12:10:52 [auto1.nl] INFO: Saving data for YH72796: {'auction_closing_time': 1774714893.0, 'created_time': 1773861304.855617, 'last_price_update_time': 1774613452.343242}
2026-03-27 12:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='YH72796') HTTP/1.1" 204 0
2026-03-27 12:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg31%252Fe9%252F31e93b4b2f1af9e4c69d29706eaf09e9%252Fpa%252FNY57976_9dd9faa5d8950e30a02bfc35d16a7487.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:10:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/e9/31e93b4b2f1af9e4c69d29706eaf09e9/pa/NY57976_9dd9faa5d8950e30a02bfc35d16a7487.jpg not downloaded yet
2026-03-27 12:10:52 [auto1.nl] INFO: Found listing with ID: FE21861
2026-03-27 12:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FE21861%27 HTTP/1.1" 200 None
2026-03-27 12:10:52 [auto1.nl] INFO: Scrape type for FE21861: 2
2026-03-27 12:10:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1ed2ca5e-b39d-52ec-811e-1f4acb82e055 with identifier: FE21861
2026-03-27 12:10:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1ed2ca5e-b39d-52ec-811e-1f4acb82e055 with scrape type 2
2026-03-27 12:10:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1ed2ca5e-b39d-52ec-811e-1f4acb82e055 with scrape type 2
2026-03-27 12:10:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 1ed2ca5e-b39d-52ec-811e-1f4acb82e055, identifier: FE21861
2026-03-27 12:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252F4f%252F474f7861a373700e675deea527d017ce%252Fpa%252FBU16200_20f60c172bd6b06c908d9b2b9bb36547.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:10:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/4f/474f7861a373700e675deea527d017ce/pa/BU16200_20f60c172bd6b06c908d9b2b9bb36547.jpg not downloaded yet
2026-03-27 12:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F34%252Fae344a715587a9cce542943901610cdf%252Fpa%252FDA49617_8977fbde6e94281221f451b0387fb75c.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:10:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/34/ae344a715587a9cce542943901610cdf/pa/DA49617_8977fbde6e94281221f451b0387fb75c.jpg not downloaded yet
2026-03-27 12:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg68%252Fc4%252F68c4f8ed3c358c3ecbaf57f5db9f31fa%252Fpa%252FWU34213_611af52499ff6e53f7c1b625e3424f10.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:10:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/c4/68c4f8ed3c358c3ecbaf57f5db9f31fa/pa/WU34213_611af52499ff6e53f7c1b625e3424f10.jpg not downloaded yet
2026-03-27 12:10:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 1ed2ca5e-b39d-52ec-811e-1f4acb82e055 with identifier: FE21861
2026-03-27 12:10:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 1ed2ca5e-b39d-52ec-811e-1f4acb82e055 with identifier: FE21861
2026-03-27 12:10:52 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 1ed2ca5e-b39d-52ec-811e-1f4acb82e055 with identifier: FE21861 to the API
2026-03-27 12:10:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 12:10:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 12:10:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 292,
 'expiration_date': '2026-03-28T16:15:40Z',
 'fuel_type': 'hybrid',
 'id': '1ed2ca5e-b39d-52ec-811e-1f4acb82e055',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FE21861',
 'listing': 'auction',
 'make': 'BMW',
 'model': '5er',
 'odometer': 149076,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-04-21',
 'seller_name': None,
 'title': 'BMW 5er 530e',
 'transmission': 'automatic',
 'trim': '',
 'year': 2022}
2026-03-27 12:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FE21861%27 HTTP/1.1" 200 None
2026-03-27 12:10:53 [auto1.nl] INFO: Saving data for FE21861: {'auction_closing_time': 1774714540.0, 'created_time': 1773774764.56175, 'last_price_update_time': 1774613453.450771}
2026-03-27 12:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='FE21861') HTTP/1.1" 204 0
2026-03-27 12:10:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgae/34/ae344a715587a9cce542943901610cdf/pa/DA49617_d2196b5dd48731d600b684ac659836b2.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:10:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img68/c4/68c4f8ed3c358c3ecbaf57f5db9f31fa/pa/WU34213_3ffe179694ee36cd9ee364d8ef4bd561.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:10:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img31/e9/31e93b4b2f1af9e4c69d29706eaf09e9/pa/NY57976_ebe98eda2cdb98d37056036f7d4009a3.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:10:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgae/34/ae344a715587a9cce542943901610cdf/pa/DA49617_0e3c3d4b143ac940b154af1430b4d0d9.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg31%252Fe9%252F31e93b4b2f1af9e4c69d29706eaf09e9%252Fpa%252FNY57976_988a0a8ad434a8f3e849c3921eb5593a.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:10:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/e9/31e93b4b2f1af9e4c69d29706eaf09e9/pa/NY57976_988a0a8ad434a8f3e849c3921eb5593a.jpg not downloaded yet
2026-03-27 12:10:53 [auto1.nl] INFO: Found listing with ID: SV00912
2026-03-27 12:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SV00912%27 HTTP/1.1" 200 None
2026-03-27 12:10:53 [auto1.nl] INFO: Scrape type for SV00912: 2
2026-03-27 12:10:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7102d58d-8e12-51ba-90bf-5b632bc53acf with identifier: SV00912
2026-03-27 12:10:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7102d58d-8e12-51ba-90bf-5b632bc53acf with scrape type 2
2026-03-27 12:10:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7102d58d-8e12-51ba-90bf-5b632bc53acf with scrape type 2
2026-03-27 12:10:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 7102d58d-8e12-51ba-90bf-5b632bc53acf, identifier: SV00912
2026-03-27 12:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252F4f%252F474f7861a373700e675deea527d017ce%252Fpa%252FBU16200_dbc5ffb7f25f3bdaa5ce8fd50030d670.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:10:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/4f/474f7861a373700e675deea527d017ce/pa/BU16200_dbc5ffb7f25f3bdaa5ce8fd50030d670.jpg not downloaded yet
2026-03-27 12:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F34%252Fae344a715587a9cce542943901610cdf%252Fpa%252FDA49617_7c1acbec512436c35f1e476b5f20024e.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:10:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/34/ae344a715587a9cce542943901610cdf/pa/DA49617_7c1acbec512436c35f1e476b5f20024e.jpg not downloaded yet
2026-03-27 12:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg68%252Fc4%252F68c4f8ed3c358c3ecbaf57f5db9f31fa%252Fpa%252FWU34213_1cdbaac3a343ac09274c58f81a8331da.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:10:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/c4/68c4f8ed3c358c3ecbaf57f5db9f31fa/pa/WU34213_1cdbaac3a343ac09274c58f81a8331da.jpg not downloaded yet
2026-03-27 12:10:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 7102d58d-8e12-51ba-90bf-5b632bc53acf with identifier: SV00912
2026-03-27 12:10:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 7102d58d-8e12-51ba-90bf-5b632bc53acf with identifier: SV00912
2026-03-27 12:10:53 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 7102d58d-8e12-51ba-90bf-5b632bc53acf with identifier: SV00912 to the API
2026-03-27 12:10:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 12:10:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 12:10:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 245,
 'expiration_date': '2026-03-28T16:56:03Z',
 'fuel_type': 'petrol',
 'id': '7102d58d-8e12-51ba-90bf-5b632bc53acf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SV00912',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 251869,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-06-13',
 'seller_name': None,
 'title': 'BMW 3er 328i',
 'transmission': 'automatic',
 'trim': '',
 'year': 2013}
2026-03-27 12:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SV00912%27 HTTP/1.1" 200 None
2026-03-27 12:10:53 [auto1.nl] INFO: Saving data for SV00912: {'auction_closing_time': 1774716963.0, 'created_time': 1774293144.132, 'last_price_update_time': 1774613453.983804}
2026-03-27 12:10:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='SV00912') HTTP/1.1" 204 0
2026-03-27 12:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg31%252Fe9%252F31e93b4b2f1af9e4c69d29706eaf09e9%252Fpa%252FNY57976_34775b390ebd47f7978c99024117ae6e.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:10:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/e9/31e93b4b2f1af9e4c69d29706eaf09e9/pa/NY57976_34775b390ebd47f7978c99024117ae6e.jpg not downloaded yet
2026-03-27 12:10:54 [auto1.nl] INFO: Found listing with ID: BP06390
2026-03-27 12:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BP06390%27 HTTP/1.1" 200 None
2026-03-27 12:10:54 [auto1.nl] INFO: Scrape type for BP06390: 2
2026-03-27 12:10:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 08a060f5-5277-5051-b7fb-71f560fa26d1 with identifier: BP06390
2026-03-27 12:10:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 08a060f5-5277-5051-b7fb-71f560fa26d1 with scrape type 2
2026-03-27 12:10:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 08a060f5-5277-5051-b7fb-71f560fa26d1 with scrape type 2
2026-03-27 12:10:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 08a060f5-5277-5051-b7fb-71f560fa26d1, identifier: BP06390
2026-03-27 12:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252F4f%252F474f7861a373700e675deea527d017ce%252Fpa%252FBU16200_6743c2fe443c3df45db8fc664d63853e.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:10:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/4f/474f7861a373700e675deea527d017ce/pa/BU16200_6743c2fe443c3df45db8fc664d63853e.jpg not downloaded yet
2026-03-27 12:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg68%252Fc4%252F68c4f8ed3c358c3ecbaf57f5db9f31fa%252Fpa%252FWU34213_c58c67b408aa72cc70e9231ef34b0f50.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:10:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/c4/68c4f8ed3c358c3ecbaf57f5db9f31fa/pa/WU34213_c58c67b408aa72cc70e9231ef34b0f50.jpg not downloaded yet
2026-03-27 12:10:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 08a060f5-5277-5051-b7fb-71f560fa26d1 with identifier: BP06390
2026-03-27 12:10:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 08a060f5-5277-5051-b7fb-71f560fa26d1 with identifier: BP06390
2026-03-27 12:10:54 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 08a060f5-5277-5051-b7fb-71f560fa26d1 with identifier: BP06390 to the API
2026-03-27 12:10:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 12:10:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 12:10:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-28T16:07:14Z',
 'fuel_type': 'petrol',
 'id': '08a060f5-5277-5051-b7fb-71f560fa26d1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BP06390',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 135881,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-07-26',
 'seller_name': None,
 'title': 'Volkswagen Polo 1.0 TSI Trendline BlueMotion',
 'transmission': 'manual',
 'trim': 'Trendline BlueMotion',
 'year': 2017}
2026-03-27 12:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BP06390%27 HTTP/1.1" 200 None
2026-03-27 12:10:54 [auto1.nl] INFO: Saving data for BP06390: {'auction_closing_time': 1774714034.0, 'created_time': 1773688304.691821, 'last_price_update_time': 1774613454.583537}
2026-03-27 12:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='BP06390') HTTP/1.1" 204 0
2026-03-27 12:10:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:10:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7cfdfbc7d0>
2026-03-27 12:10:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:10:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:10:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:10:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_51b97771-700f-5d91-a60b-59b108a49e15/51b97771-700f-5d91-a60b-59b108a49e15_image_1.jpg HTTP/1.1" 201 0
2026-03-27 12:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F34%252Fae344a715587a9cce542943901610cdf%252Fpa%252FDA49617_d2196b5dd48731d600b684ac659836b2.jpg') HTTP/1.1" 204 0
2026-03-27 12:10:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/34/ae344a715587a9cce542943901610cdf/pa/DA49617_d2196b5dd48731d600b684ac659836b2.jpg saved to cache
2026-03-27 12:10:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 51b97771-700f-5d91-a60b-59b108a49e15
2026-03-27 12:10:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:10:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7cfdf06dd0>
2026-03-27 12:10:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:10:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:10:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:10:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_77737d54-e208-58bd-b23d-d89e6e2f3656/77737d54-e208-58bd-b23d-d89e6e2f3656_image_1.jpg HTTP/1.1" 201 0
2026-03-27 12:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg68%252Fc4%252F68c4f8ed3c358c3ecbaf57f5db9f31fa%252Fpa%252FWU34213_3ffe179694ee36cd9ee364d8ef4bd561.jpg') HTTP/1.1" 204 0
2026-03-27 12:10:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/c4/68c4f8ed3c358c3ecbaf57f5db9f31fa/pa/WU34213_3ffe179694ee36cd9ee364d8ef4bd561.jpg saved to cache
2026-03-27 12:10:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 77737d54-e208-58bd-b23d-d89e6e2f3656
2026-03-27 12:10:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:10:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7cfe020890>
2026-03-27 12:10:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:10:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:10:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:10:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7c40c185-843e-5d61-911e-4bee8fe9d413/7c40c185-843e-5d61-911e-4bee8fe9d413_image_1.jpg HTTP/1.1" 201 0
2026-03-27 12:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg31%252Fe9%252F31e93b4b2f1af9e4c69d29706eaf09e9%252Fpa%252FNY57976_ebe98eda2cdb98d37056036f7d4009a3.jpg') HTTP/1.1" 204 0
2026-03-27 12:10:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/e9/31e93b4b2f1af9e4c69d29706eaf09e9/pa/NY57976_ebe98eda2cdb98d37056036f7d4009a3.jpg saved to cache
2026-03-27 12:10:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 7c40c185-843e-5d61-911e-4bee8fe9d413
2026-03-27 12:10:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:10:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7cfe023b10>
2026-03-27 12:10:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:10:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:10:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:10:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_51b97771-700f-5d91-a60b-59b108a49e15/51b97771-700f-5d91-a60b-59b108a49e15_image_0.jpg HTTP/1.1" 201 0
2026-03-27 12:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F34%252Fae344a715587a9cce542943901610cdf%252Fpa%252FDA49617_0e3c3d4b143ac940b154af1430b4d0d9.jpg') HTTP/1.1" 204 0
2026-03-27 12:10:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/34/ae344a715587a9cce542943901610cdf/pa/DA49617_0e3c3d4b143ac940b154af1430b4d0d9.jpg saved to cache
2026-03-27 12:10:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 51b97771-700f-5d91-a60b-59b108a49e15
2026-03-27 12:10:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img68/c4/68c4f8ed3c358c3ecbaf57f5db9f31fa/pa/WU34213_8cddec371edcdd5398494e52ebc998f6.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg31%252Fe9%252F31e93b4b2f1af9e4c69d29706eaf09e9%252Fpa%252FNY57976_235b3d31703fb04f757eeaa34ef82044.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:10:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/e9/31e93b4b2f1af9e4c69d29706eaf09e9/pa/NY57976_235b3d31703fb04f757eeaa34ef82044.jpg not downloaded yet
2026-03-27 12:10:54 [auto1.nl] INFO: Found listing with ID: SV78620
2026-03-27 12:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SV78620%27 HTTP/1.1" 200 None
2026-03-27 12:10:54 [auto1.nl] INFO: Scrape type for SV78620: 2
2026-03-27 12:10:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 31ff8b98-3084-5d24-b564-e88479fc5c4f with identifier: SV78620
2026-03-27 12:10:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 31ff8b98-3084-5d24-b564-e88479fc5c4f with scrape type 2
2026-03-27 12:10:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 31ff8b98-3084-5d24-b564-e88479fc5c4f with scrape type 2
2026-03-27 12:10:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 31ff8b98-3084-5d24-b564-e88479fc5c4f, identifier: SV78620
2026-03-27 12:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252F4f%252F474f7861a373700e675deea527d017ce%252Fpa%252FBU16200_800245c2175d2abdf4b72ae0ea2a3e6d.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:10:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/4f/474f7861a373700e675deea527d017ce/pa/BU16200_800245c2175d2abdf4b72ae0ea2a3e6d.jpg not downloaded yet
2026-03-27 12:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg68%252Fc4%252F68c4f8ed3c358c3ecbaf57f5db9f31fa%252Fpa%252FWU34213_2d7eef1f2416e6c9e2b386f2f975573f.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:10:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/c4/68c4f8ed3c358c3ecbaf57f5db9f31fa/pa/WU34213_2d7eef1f2416e6c9e2b386f2f975573f.jpg not downloaded yet
2026-03-27 12:10:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgae/34/ae344a715587a9cce542943901610cdf/pa/DA49617_9d5b84ec1c1a8ee411b7b720554c9f35.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:10:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img47/4f/474f7861a373700e675deea527d017ce/pa/BU16200_df499e026ee5905574e17356299b5e29.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:10:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 31ff8b98-3084-5d24-b564-e88479fc5c4f with identifier: SV78620
2026-03-27 12:10:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 31ff8b98-3084-5d24-b564-e88479fc5c4f with identifier: SV78620
2026-03-27 12:10:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 31ff8b98-3084-5d24-b564-e88479fc5c4f with identifier: SV78620 to the API
2026-03-27 12:10:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 12:10:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 12:10:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:35:16Z',
 'fuel_type': 'diesel',
 'id': '31ff8b98-3084-5d24-b564-e88479fc5c4f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SV78620',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Passat',
 'odometer': 150133,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-01-02',
 'seller_name': None,
 'title': 'Volkswagen Passat 2.0 TDI Highline BlueMotion',
 'transmission': 'automatic',
 'trim': 'Highline BlueMotion',
 'year': 2015}
2026-03-27 12:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SV78620%27 HTTP/1.1" 200 None
2026-03-27 12:10:55 [auto1.nl] INFO: Saving data for SV78620: {'auction_closing_time': 1774715716.0, 'created_time': 1773132445.149576, 'last_price_update_time': 1774613455.247355}
2026-03-27 12:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='SV78620') HTTP/1.1" 204 0
2026-03-27 12:10:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ZZ76935> (referer: https://www.auto1.com/v1/car-details-view/ZZ76935/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 12:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg31%252Fe9%252F31e93b4b2f1af9e4c69d29706eaf09e9%252Fpa%252FNY57976_20cc6b735d6f2056e4a15f802e8791e8.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:10:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/e9/31e93b4b2f1af9e4c69d29706eaf09e9/pa/NY57976_20cc6b735d6f2056e4a15f802e8791e8.jpg not downloaded yet
2026-03-27 12:10:55 [auto1.nl] INFO: Found listing with ID: PP29341
2026-03-27 12:10:55 [auto1.nl] INFO: Found listing with ID: JX11008
2026-03-27 12:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JX11008%27 HTTP/1.1" 200 None
2026-03-27 12:10:55 [auto1.nl] INFO: Scrape type for JX11008: 2
2026-03-27 12:10:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0a8b9678-0d61-5def-8158-cc26e8801efd with identifier: JX11008
2026-03-27 12:10:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0a8b9678-0d61-5def-8158-cc26e8801efd with scrape type 2
2026-03-27 12:10:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0a8b9678-0d61-5def-8158-cc26e8801efd with scrape type 2
2026-03-27 12:10:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 0a8b9678-0d61-5def-8158-cc26e8801efd, identifier: JX11008
2026-03-27 12:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252F4f%252F474f7861a373700e675deea527d017ce%252Fpa%252FBU16200_9474b838eef89ba9eb16339c58d6de85.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:10:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/4f/474f7861a373700e675deea527d017ce/pa/BU16200_9474b838eef89ba9eb16339c58d6de85.jpg not downloaded yet
2026-03-27 12:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg68%252Fc4%252F68c4f8ed3c358c3ecbaf57f5db9f31fa%252Fpa%252FWU34213_44e73149d703c0254adb6722ead56e9d.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:10:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/c4/68c4f8ed3c358c3ecbaf57f5db9f31fa/pa/WU34213_44e73149d703c0254adb6722ead56e9d.jpg not downloaded yet
2026-03-27 12:10:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 0a8b9678-0d61-5def-8158-cc26e8801efd with identifier: JX11008
2026-03-27 12:10:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 0a8b9678-0d61-5def-8158-cc26e8801efd with identifier: JX11008
2026-03-27 12:10:55 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 0a8b9678-0d61-5def-8158-cc26e8801efd with identifier: JX11008 to the API
2026-03-27 12:10:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 12:10:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 12:10:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-28T16:17:20Z',
 'fuel_type': 'petrol',
 'id': '0a8b9678-0d61-5def-8158-cc26e8801efd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JX11008',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C3 Picasso',
 'odometer': 93298,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-03-02',
 'seller_name': None,
 'title': 'Citroen C3 Picasso 1.2 PureTech Selection',
 'transmission': 'manual',
 'trim': 'Selection',
 'year': 2016}
2026-03-27 12:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JX11008%27 HTTP/1.1" 200 None
2026-03-27 12:10:55 [auto1.nl] INFO: Saving data for JX11008: {'auction_closing_time': 1774714640.0, 'created_time': 1773749658.91943, 'last_price_update_time': 1774613455.753688}
2026-03-27 12:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='JX11008') HTTP/1.1" 204 0
2026-03-27 12:10:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img47/4f/474f7861a373700e675deea527d017ce/pa/BU16200_20f60c172bd6b06c908d9b2b9bb36547.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:10:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgae/34/ae344a715587a9cce542943901610cdf/pa/DA49617_8977fbde6e94281221f451b0387fb75c.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:10:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img68/c4/68c4f8ed3c358c3ecbaf57f5db9f31fa/pa/WU34213_611af52499ff6e53f7c1b625e3424f10.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg31%252Fe9%252F31e93b4b2f1af9e4c69d29706eaf09e9%252Fpa%252FNY57976_7d5972a26306d6729efa2c42da1a25cb.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:10:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/e9/31e93b4b2f1af9e4c69d29706eaf09e9/pa/NY57976_7d5972a26306d6729efa2c42da1a25cb.jpg not downloaded yet
2026-03-27 12:10:55 [auto1.nl] INFO: Found listing with ID: YT76844
2026-03-27 12:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YT76844%27 HTTP/1.1" 200 None
2026-03-27 12:10:55 [auto1.nl] INFO: Scrape type for YT76844: 2
2026-03-27 12:10:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: daf5ea50-607b-5503-ae3d-b3e4e21cde23 with identifier: YT76844
2026-03-27 12:10:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item daf5ea50-607b-5503-ae3d-b3e4e21cde23 with scrape type 2
2026-03-27 12:10:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item daf5ea50-607b-5503-ae3d-b3e4e21cde23 with scrape type 2
2026-03-27 12:10:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: daf5ea50-607b-5503-ae3d-b3e4e21cde23, identifier: YT76844
2026-03-27 12:10:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252F4f%252F474f7861a373700e675deea527d017ce%252Fpa%252FBU16200_db29f35b9517301b585265ca4d830b77.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:10:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/4f/474f7861a373700e675deea527d017ce/pa/BU16200_db29f35b9517301b585265ca4d830b77.jpg not downloaded yet
2026-03-27 12:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg68%252Fc4%252F68c4f8ed3c358c3ecbaf57f5db9f31fa%252Fpa%252FWU34213_78802cd21f5faa0271471db712d05f73.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:10:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/c4/68c4f8ed3c358c3ecbaf57f5db9f31fa/pa/WU34213_78802cd21f5faa0271471db712d05f73.jpg not downloaded yet
2026-03-27 12:10:56 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 12:10:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:10:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7d00294450>
2026-03-27 12:10:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:10:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:10:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:10:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_77737d54-e208-58bd-b23d-d89e6e2f3656/77737d54-e208-58bd-b23d-d89e6e2f3656_image_2.jpg HTTP/1.1" 201 0
2026-03-27 12:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg68%252Fc4%252F68c4f8ed3c358c3ecbaf57f5db9f31fa%252Fpa%252FWU34213_8cddec371edcdd5398494e52ebc998f6.jpg') HTTP/1.1" 204 0
2026-03-27 12:10:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/c4/68c4f8ed3c358c3ecbaf57f5db9f31fa/pa/WU34213_8cddec371edcdd5398494e52ebc998f6.jpg saved to cache
2026-03-27 12:10:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 77737d54-e208-58bd-b23d-d89e6e2f3656
2026-03-27 12:10:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:10:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7cfdf01110>
2026-03-27 12:10:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:10:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:10:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:10:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_51b97771-700f-5d91-a60b-59b108a49e15/51b97771-700f-5d91-a60b-59b108a49e15_image_2.jpg HTTP/1.1" 201 0
2026-03-27 12:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F34%252Fae344a715587a9cce542943901610cdf%252Fpa%252FDA49617_9d5b84ec1c1a8ee411b7b720554c9f35.jpg') HTTP/1.1" 204 0
2026-03-27 12:10:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/34/ae344a715587a9cce542943901610cdf/pa/DA49617_9d5b84ec1c1a8ee411b7b720554c9f35.jpg saved to cache
2026-03-27 12:10:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 51b97771-700f-5d91-a60b-59b108a49e15
2026-03-27 12:10:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:10:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7cfce39a10>
2026-03-27 12:10:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:10:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:10:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:10:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a1d476b6-ca15-5b1b-b633-eafb1a6a0d81/a1d476b6-ca15-5b1b-b633-eafb1a6a0d81_image_2.jpg HTTP/1.1" 201 0
2026-03-27 12:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252F4f%252F474f7861a373700e675deea527d017ce%252Fpa%252FBU16200_df499e026ee5905574e17356299b5e29.jpg') HTTP/1.1" 204 0
2026-03-27 12:10:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/4f/474f7861a373700e675deea527d017ce/pa/BU16200_df499e026ee5905574e17356299b5e29.jpg saved to cache
2026-03-27 12:10:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a1d476b6-ca15-5b1b-b633-eafb1a6a0d81
2026-03-27 12:10:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: daf5ea50-607b-5503-ae3d-b3e4e21cde23 with identifier: YT76844
2026-03-27 12:10:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: daf5ea50-607b-5503-ae3d-b3e4e21cde23 with identifier: YT76844
2026-03-27 12:10:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: daf5ea50-607b-5503-ae3d-b3e4e21cde23 with identifier: YT76844 to the API
2026-03-27 12:10:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 12:10:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 12:10:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 155,
 'expiration_date': '2026-03-28T16:55:57Z',
 'fuel_type': 'petrol',
 'id': 'daf5ea50-607b-5503-ae3d-b3e4e21cde23',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YT76844',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '308',
 'odometer': 140074,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-03-26',
 'seller_name': None,
 'title': 'Peugeot 308 1.6 THP Allure',
 'transmission': 'manual',
 'trim': 'Allure',
 'year': 2015}
2026-03-27 12:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YT76844%27 HTTP/1.1" 200 None
2026-03-27 12:10:56 [auto1.nl] INFO: Saving data for YT76844: {'auction_closing_time': 1774716957.0, 'created_time': 1774293126.048266, 'last_price_update_time': 1774613456.446828}
2026-03-27 12:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='YT76844') HTTP/1.1" 204 0
2026-03-27 12:10:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PY55457> (referer: https://www.auto1.com/v1/car-details-view/PY55457/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 12:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg31%252Fe9%252F31e93b4b2f1af9e4c69d29706eaf09e9%252Fpa%252FNY57976_da862e36c49265ec9d1ce82f97a5fdbe.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:10:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/e9/31e93b4b2f1af9e4c69d29706eaf09e9/pa/NY57976_da862e36c49265ec9d1ce82f97a5fdbe.jpg not downloaded yet
2026-03-27 12:10:56 [auto1.nl] INFO: Found listing with ID: WR76222
2026-03-27 12:10:56 [auto1.nl] INFO: Found listing with ID: ME73088
2026-03-27 12:10:56 [auto1.nl] INFO: Found listing with ID: UJ24113
2026-03-27 12:10:56 [auto1.nl] INFO: Found listing with ID: BC03068
2026-03-27 12:10:56 [auto1.nl] INFO: Found listing with ID: RC74228
2026-03-27 12:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RC74228%27 HTTP/1.1" 200 None
2026-03-27 12:10:56 [auto1.nl] INFO: Scrape type for RC74228: 2
2026-03-27 12:10:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 31976e2f-167d-5f4f-9a04-ea038cb88b30 with identifier: RC74228
2026-03-27 12:10:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 31976e2f-167d-5f4f-9a04-ea038cb88b30 with scrape type 2
2026-03-27 12:10:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 31976e2f-167d-5f4f-9a04-ea038cb88b30 with scrape type 2
2026-03-27 12:10:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 31976e2f-167d-5f4f-9a04-ea038cb88b30, identifier: RC74228
2026-03-27 12:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252F4f%252F474f7861a373700e675deea527d017ce%252Fpa%252FBU16200_19b6a5f76a129af85e32e0ba8ec72533.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:10:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/4f/474f7861a373700e675deea527d017ce/pa/BU16200_19b6a5f76a129af85e32e0ba8ec72533.jpg not downloaded yet
2026-03-27 12:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg68%252Fc4%252F68c4f8ed3c358c3ecbaf57f5db9f31fa%252Fpa%252FWU34213_cf410d91f1d13bf6e26d9a67a686d414.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:10:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/c4/68c4f8ed3c358c3ecbaf57f5db9f31fa/pa/WU34213_cf410d91f1d13bf6e26d9a67a686d414.jpg not downloaded yet
2026-03-27 12:10:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: de9ef2ce-dced-52e2-a8d9-ed0810e1cfdf with identifier: ZZ76935
2026-03-27 12:10:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item de9ef2ce-dced-52e2-a8d9-ed0810e1cfdf with scrape type 1
2026-03-27 12:10:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 4 photos for item de9ef2ce-dced-52e2-a8d9-ed0810e1cfdf
2026-03-27 12:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge5%252Fa6%252Fe5a6f672b5b54a745a2c201beb29b33b%252Fpa%252FZZ76935_054ea0d12b9f605f81839d9f461589ef.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:10:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/a6/e5a6f672b5b54a745a2c201beb29b33b/pa/ZZ76935_054ea0d12b9f605f81839d9f461589ef.jpg not downloaded yet
2026-03-27 12:10:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img31/e9/31e93b4b2f1af9e4c69d29706eaf09e9/pa/NY57976_9dd9faa5d8950e30a02bfc35d16a7487.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:10:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img68/c4/68c4f8ed3c358c3ecbaf57f5db9f31fa/pa/WU34213_c58c67b408aa72cc70e9231ef34b0f50.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:10:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img68/c4/68c4f8ed3c358c3ecbaf57f5db9f31fa/pa/WU34213_1cdbaac3a343ac09274c58f81a8331da.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:10:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 31976e2f-167d-5f4f-9a04-ea038cb88b30 with identifier: RC74228
2026-03-27 12:10:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 31976e2f-167d-5f4f-9a04-ea038cb88b30 with identifier: RC74228
2026-03-27 12:10:56 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 31976e2f-167d-5f4f-9a04-ea038cb88b30 with identifier: RC74228 to the API
2026-03-27 12:10:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 12:10:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 12:10:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 190,
 'expiration_date': '2026-03-28T16:26:01Z',
 'fuel_type': 'petrol',
 'id': '31976e2f-167d-5f4f-9a04-ea038cb88b30',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RC74228',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A4',
 'odometer': 209670,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-01-22',
 'seller_name': None,
 'title': 'Audi A4 2.0 TFSI Sport ultra',
 'transmission': 'automatic',
 'trim': 'Sport ultra',
 'year': 2018}
2026-03-27 12:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RC74228%27 HTTP/1.1" 200 None
2026-03-27 12:10:56 [auto1.nl] INFO: Saving data for RC74228: {'auction_closing_time': 1774715161.0, 'created_time': 1773688671.00132, 'last_price_update_time': 1774613456.978247}
2026-03-27 12:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='RC74228') HTTP/1.1" 204 0
2026-03-27 12:10:57 [auto1.nl] INFO: Found listing with ID: YN14337
2026-03-27 12:10:57 [auto1.nl] INFO: Found listing with ID: VM29173
2026-03-27 12:10:57 [auto1.nl] INFO: Found listing with ID: RR80165
2026-03-27 12:10:57 [auto1.nl] INFO: Found listing with ID: PA43644
2026-03-27 12:10:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PA43644%27 HTTP/1.1" 200 None
2026-03-27 12:10:57 [auto1.nl] INFO: Scrape type for PA43644: 2
2026-03-27 12:10:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3c1ae3d0-e1ec-52cb-893e-61e62c7d3705 with identifier: PA43644
2026-03-27 12:10:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3c1ae3d0-e1ec-52cb-893e-61e62c7d3705 with scrape type 2
2026-03-27 12:10:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3c1ae3d0-e1ec-52cb-893e-61e62c7d3705 with scrape type 2
2026-03-27 12:10:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 3c1ae3d0-e1ec-52cb-893e-61e62c7d3705, identifier: PA43644
2026-03-27 12:10:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge5%252Fa6%252Fe5a6f672b5b54a745a2c201beb29b33b%252Fpa%252FZZ76935_e7e936fb5a723d404d5e22a1802e94ea.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:10:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/a6/e5a6f672b5b54a745a2c201beb29b33b/pa/ZZ76935_e7e936fb5a723d404d5e22a1802e94ea.jpg not downloaded yet
2026-03-27 12:10:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 3c1ae3d0-e1ec-52cb-893e-61e62c7d3705 with identifier: PA43644
2026-03-27 12:10:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-27 12:10:57 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=brown HTTP/1.1" 200 None
2026-03-27 12:10:57 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 12:10:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-27 12:10:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 3c1ae3d0-e1ec-52cb-893e-61e62c7d3705 with identifier: PA43644
2026-03-27 12:10:57 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 3c1ae3d0-e1ec-52cb-893e-61e62c7d3705 with identifier: PA43644 to the API
2026-03-27 12:10:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 12:10:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 12:10:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 230,
 'expiration_date': '2026-03-28T16:27:19Z',
 'fuel_type': 'hybrid',
 'id': '3c1ae3d0-e1ec-52cb-893e-61e62c7d3705',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PA43644',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'Tucson',
 'odometer': 32375,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-07-10',
 'seller_name': None,
 'title': 'Hyundai Tucson 1.6 T-GDI Hybrid Intuitive 2WD',
 'transmission': 'automatic',
 'trim': 'Intuitive 2WD',
 'year': 2023}
2026-03-27 12:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PA43644%27 HTTP/1.1" 200 None
2026-03-27 12:10:58 [auto1.nl] INFO: Saving data for PA43644: {'auction_closing_time': 1774715239.0, 'created_time': 1773229580.841529, 'last_price_update_time': 1774613458.485112}
2026-03-27 12:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='PA43644') HTTP/1.1" 204 0
2026-03-27 12:10:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:10:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7cfdfbe850>
2026-03-27 12:10:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:10:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:10:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:10:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a1d476b6-ca15-5b1b-b633-eafb1a6a0d81/a1d476b6-ca15-5b1b-b633-eafb1a6a0d81_image_3.jpg HTTP/1.1" 201 0
2026-03-27 12:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252F4f%252F474f7861a373700e675deea527d017ce%252Fpa%252FBU16200_20f60c172bd6b06c908d9b2b9bb36547.jpg') HTTP/1.1" 204 0
2026-03-27 12:10:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/4f/474f7861a373700e675deea527d017ce/pa/BU16200_20f60c172bd6b06c908d9b2b9bb36547.jpg saved to cache
2026-03-27 12:10:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a1d476b6-ca15-5b1b-b633-eafb1a6a0d81
2026-03-27 12:10:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:10:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7cfdfa5b10>
2026-03-27 12:10:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:10:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:10:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:10:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_51b97771-700f-5d91-a60b-59b108a49e15/51b97771-700f-5d91-a60b-59b108a49e15_image_3.jpg HTTP/1.1" 201 0
2026-03-27 12:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F34%252Fae344a715587a9cce542943901610cdf%252Fpa%252FDA49617_8977fbde6e94281221f451b0387fb75c.jpg') HTTP/1.1" 204 0
2026-03-27 12:10:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/34/ae344a715587a9cce542943901610cdf/pa/DA49617_8977fbde6e94281221f451b0387fb75c.jpg saved to cache
2026-03-27 12:10:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 51b97771-700f-5d91-a60b-59b108a49e15
2026-03-27 12:10:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:10:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7cfce791d0>
2026-03-27 12:10:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:10:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:10:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:10:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_77737d54-e208-58bd-b23d-d89e6e2f3656/77737d54-e208-58bd-b23d-d89e6e2f3656_image_3.jpg HTTP/1.1" 201 0
2026-03-27 12:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg68%252Fc4%252F68c4f8ed3c358c3ecbaf57f5db9f31fa%252Fpa%252FWU34213_611af52499ff6e53f7c1b625e3424f10.jpg') HTTP/1.1" 204 0
2026-03-27 12:10:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/c4/68c4f8ed3c358c3ecbaf57f5db9f31fa/pa/WU34213_611af52499ff6e53f7c1b625e3424f10.jpg saved to cache
2026-03-27 12:10:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 77737d54-e208-58bd-b23d-d89e6e2f3656
2026-03-27 12:10:58 [auto1.nl] INFO: Channel: 24h | Page: 4 | totalHits: 1060 | hits on page: 40
2026-03-27 12:10:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f1ff12ea-14e0-55a1-9ae9-b43ae54b4ee2 with identifier: PY55457
2026-03-27 12:10:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f1ff12ea-14e0-55a1-9ae9-b43ae54b4ee2 with scrape type 1
2026-03-27 12:10:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item f1ff12ea-14e0-55a1-9ae9-b43ae54b4ee2
2026-03-27 12:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252F8d%252F6b8d7895763ac21dafd913653cc33e76%252Fpa%252FPY55457_4c4e65ce9fbfaec09d605e98451500eb.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:10:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/8d/6b8d7895763ac21dafd913653cc33e76/pa/PY55457_4c4e65ce9fbfaec09d605e98451500eb.jpg already downloaded
2026-03-27 12:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252F8d%252F6b8d7895763ac21dafd913653cc33e76%252Fpa%252FPY55457_ed6ead83fa95fbbee566bf1d92f654eb.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:10:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/8d/6b8d7895763ac21dafd913653cc33e76/pa/PY55457_ed6ead83fa95fbbee566bf1d92f654eb.jpg already downloaded
2026-03-27 12:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252F8d%252F6b8d7895763ac21dafd913653cc33e76%252Fpa%252FPY55457_fabd5f99ffada6443a0376a316682785.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:10:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/8d/6b8d7895763ac21dafd913653cc33e76/pa/PY55457_fabd5f99ffada6443a0376a316682785.jpg already downloaded
2026-03-27 12:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252F8d%252F6b8d7895763ac21dafd913653cc33e76%252Fpa%252FPY55457_c9503cac36d6be9f11beec6d4fca3c85.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:10:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/8d/6b8d7895763ac21dafd913653cc33e76/pa/PY55457_c9503cac36d6be9f11beec6d4fca3c85.jpg already downloaded
2026-03-27 12:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6b%252F8d%252F6b8d7895763ac21dafd913653cc33e76%252Fpa%252FPY55457_9ccaf580c80948ad72fadd3f461dc88f.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:10:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6b/8d/6b8d7895763ac21dafd913653cc33e76/pa/PY55457_9ccaf580c80948ad72fadd3f461dc88f.jpg already downloaded
2026-03-27 12:10:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: f1ff12ea-14e0-55a1-9ae9-b43ae54b4ee2, identifier: PY55457
2026-03-27 12:10:58 [auto1.nl] INFO: Found listing with ID: NT33284
2026-03-27 12:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NT33284%27 HTTP/1.1" 200 None
2026-03-27 12:10:58 [auto1.nl] INFO: Scrape type for NT33284: 2
2026-03-27 12:10:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 65cd3790-8e0e-5c15-9d8e-519de9b0a4af with identifier: NT33284
2026-03-27 12:10:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 65cd3790-8e0e-5c15-9d8e-519de9b0a4af with scrape type 2
2026-03-27 12:10:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 65cd3790-8e0e-5c15-9d8e-519de9b0a4af with scrape type 2
2026-03-27 12:10:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 65cd3790-8e0e-5c15-9d8e-519de9b0a4af, identifier: NT33284
2026-03-27 12:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge5%252Fa6%252Fe5a6f672b5b54a745a2c201beb29b33b%252Fpa%252FZZ76935_9fcafc5a140d5b5cb187e66bdedde984.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:10:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/a6/e5a6f672b5b54a745a2c201beb29b33b/pa/ZZ76935_9fcafc5a140d5b5cb187e66bdedde984.jpg not downloaded yet
2026-03-27 12:10:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: f1ff12ea-14e0-55a1-9ae9-b43ae54b4ee2 with identifier: PY55457
2026-03-27 12:10:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: f1ff12ea-14e0-55a1-9ae9-b43ae54b4ee2 with identifier: PY55457
2026-03-27 12:10:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: f1ff12ea-14e0-55a1-9ae9-b43ae54b4ee2 with identifier: PY55457 to the API
2026-03-27 12:10:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 12:10:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 12:10:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/PY55457>
{'auction_title': '',
 'c_o_2_emission_value': 106,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '1.0L',
 'engine_horse_power': 68,
 'expiration_date': '2026-03-28T16:14:44Z',
 'fuel_type': 'petrol',
 'id': 'f1ff12ea-14e0-55a1-9ae9-b43ae54b4ee2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': '21NBX1',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PY55457',
 'listing': 'auction',
 'location': 'NL, Oosterhout',
 'make': 'Toyota',
 'model': 'Aygo',
 'odometer': 208379,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 5,
 'photo_urls': ['https://img-pa.auto1.com/img6b/8d/6b8d7895763ac21dafd913653cc33e76/pa/PY55457_4c4e65ce9fbfaec09d605e98451500eb.jpg',
                'https://img-pa.auto1.com/img6b/8d/6b8d7895763ac21dafd913653cc33e76/pa/PY55457_ed6ead83fa95fbbee566bf1d92f654eb.jpg',
                'https://img-pa.auto1.com/img6b/8d/6b8d7895763ac21dafd913653cc33e76/pa/PY55457_fabd5f99ffada6443a0376a316682785.jpg',
                'https://img-pa.auto1.com/img6b/8d/6b8d7895763ac21dafd913653cc33e76/pa/PY55457_c9503cac36d6be9f11beec6d4fca3c85.jpg',
                'https://img-pa.auto1.com/img6b/8d/6b8d7895763ac21dafd913653cc33e76/pa/PY55457_9ccaf580c80948ad72fadd3f461dc88f.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f1ff12ea-14e0-55a1-9ae9-b43ae54b4ee2/f1ff12ea-14e0-55a1-9ae9-b43ae54b4ee2_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 117058,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6b/8d/6b8d7895763ac21dafd913653cc33e76/pa/PY55457_4c4e65ce9fbfaec09d605e98451500eb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f1ff12ea-14e0-55a1-9ae9-b43ae54b4ee2/f1ff12ea-14e0-55a1-9ae9-b43ae54b4ee2_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 120122,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6b/8d/6b8d7895763ac21dafd913653cc33e76/pa/PY55457_ed6ead83fa95fbbee566bf1d92f654eb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f1ff12ea-14e0-55a1-9ae9-b43ae54b4ee2/f1ff12ea-14e0-55a1-9ae9-b43ae54b4ee2_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66340,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6b/8d/6b8d7895763ac21dafd913653cc33e76/pa/PY55457_fabd5f99ffada6443a0376a316682785.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f1ff12ea-14e0-55a1-9ae9-b43ae54b4ee2/f1ff12ea-14e0-55a1-9ae9-b43ae54b4ee2_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71500,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6b/8d/6b8d7895763ac21dafd913653cc33e76/pa/PY55457_c9503cac36d6be9f11beec6d4fca3c85.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f1ff12ea-14e0-55a1-9ae9-b43ae54b4ee2/f1ff12ea-14e0-55a1-9ae9-b43ae54b4ee2_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91304,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6b/8d/6b8d7895763ac21dafd913653cc33e76/pa/PY55457_9ccaf580c80948ad72fadd3f461dc88f.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2010-08-05',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Toyota Aygo 1.0',
 'transmission': 'manual',
 'trim': '',
 'year': 2010}
2026-03-27 12:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PY55457%27 HTTP/1.1" 200 None
2026-03-27 12:10:59 [auto1.nl] INFO: Saving data for PY55457: {'created_time': 1774613459.460172, 'last_price_update_time': 1774613459.460183, 'auction_closing_time': 1774714484.0}
2026-03-27 12:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='PY55457') HTTP/1.1" 204 0
2026-03-27 12:10:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 65cd3790-8e0e-5c15-9d8e-519de9b0a4af with identifier: NT33284
2026-03-27 12:10:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 65cd3790-8e0e-5c15-9d8e-519de9b0a4af with identifier: NT33284
2026-03-27 12:10:59 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 65cd3790-8e0e-5c15-9d8e-519de9b0a4af with identifier: NT33284 to the API
2026-03-27 12:10:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 12:10:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 12:10:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-28T16:25:23Z',
 'fuel_type': 'petrol',
 'id': '65cd3790-8e0e-5c15-9d8e-519de9b0a4af',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NT33284',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Polo',
 'odometer': 111701,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-08-26',
 'seller_name': None,
 'title': 'Volkswagen Polo 1.0 TSI Comfortline',
 'transmission': 'manual',
 'trim': 'Comfortline',
 'year': 2018}
2026-03-27 12:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NT33284%27 HTTP/1.1" 200 None
2026-03-27 12:10:59 [auto1.nl] INFO: Saving data for NT33284: {'auction_closing_time': 1774715123.0, 'created_time': 1773688667.240473, 'last_price_update_time': 1774613459.790906}
2026-03-27 12:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='NT33284') HTTP/1.1" 204 0
2026-03-27 12:10:59 [auto1.nl] INFO: Found listing with ID: HT40495
2026-03-27 12:10:59 [auto1.nl] INFO: Found listing with ID: WZ36257
2026-03-27 12:10:59 [auto1.nl] INFO: Found listing with ID: CY67010
2026-03-27 12:10:59 [auto1.nl] INFO: Found listing with ID: XJ71773
2026-03-27 12:10:59 [auto1.nl] INFO: Found listing with ID: AE06801
2026-03-27 12:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AE06801%27 HTTP/1.1" 200 None
2026-03-27 12:10:59 [auto1.nl] INFO: Scrape type for AE06801: 2
2026-03-27 12:10:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cfff64aa-bf53-54ac-a935-97ce27e75a3b with identifier: AE06801
2026-03-27 12:10:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cfff64aa-bf53-54ac-a935-97ce27e75a3b with scrape type 2
2026-03-27 12:10:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cfff64aa-bf53-54ac-a935-97ce27e75a3b with scrape type 2
2026-03-27 12:10:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: cfff64aa-bf53-54ac-a935-97ce27e75a3b, identifier: AE06801
2026-03-27 12:10:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:10:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7cfdf8ef50>
2026-03-27 12:10:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:10:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:10:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:10:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7c40c185-843e-5d61-911e-4bee8fe9d413/7c40c185-843e-5d61-911e-4bee8fe9d413_image_3.jpg HTTP/1.1" 201 0
2026-03-27 12:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg31%252Fe9%252F31e93b4b2f1af9e4c69d29706eaf09e9%252Fpa%252FNY57976_9dd9faa5d8950e30a02bfc35d16a7487.jpg') HTTP/1.1" 204 0
2026-03-27 12:10:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/e9/31e93b4b2f1af9e4c69d29706eaf09e9/pa/NY57976_9dd9faa5d8950e30a02bfc35d16a7487.jpg saved to cache
2026-03-27 12:10:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 7c40c185-843e-5d61-911e-4bee8fe9d413
2026-03-27 12:10:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:10:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7cfcde2750>
2026-03-27 12:10:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:10:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:10:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:10:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_77737d54-e208-58bd-b23d-d89e6e2f3656/77737d54-e208-58bd-b23d-d89e6e2f3656_image_5.jpg HTTP/1.1" 201 0
2026-03-27 12:10:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg68%252Fc4%252F68c4f8ed3c358c3ecbaf57f5db9f31fa%252Fpa%252FWU34213_c58c67b408aa72cc70e9231ef34b0f50.jpg') HTTP/1.1" 204 0
2026-03-27 12:11:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/c4/68c4f8ed3c358c3ecbaf57f5db9f31fa/pa/WU34213_c58c67b408aa72cc70e9231ef34b0f50.jpg saved to cache
2026-03-27 12:11:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 77737d54-e208-58bd-b23d-d89e6e2f3656
2026-03-27 12:11:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:11:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7cfdf12950>
2026-03-27 12:11:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:11:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:11:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:11:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_77737d54-e208-58bd-b23d-d89e6e2f3656/77737d54-e208-58bd-b23d-d89e6e2f3656_image_4.jpg HTTP/1.1" 201 0
2026-03-27 12:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg68%252Fc4%252F68c4f8ed3c358c3ecbaf57f5db9f31fa%252Fpa%252FWU34213_1cdbaac3a343ac09274c58f81a8331da.jpg') HTTP/1.1" 204 0
2026-03-27 12:11:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/c4/68c4f8ed3c358c3ecbaf57f5db9f31fa/pa/WU34213_1cdbaac3a343ac09274c58f81a8331da.jpg saved to cache
2026-03-27 12:11:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 77737d54-e208-58bd-b23d-d89e6e2f3656
2026-03-27 12:11:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img31/e9/31e93b4b2f1af9e4c69d29706eaf09e9/pa/NY57976_34775b390ebd47f7978c99024117ae6e.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:11:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img68/c4/68c4f8ed3c358c3ecbaf57f5db9f31fa/pa/WU34213_2d7eef1f2416e6c9e2b386f2f975573f.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:11:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img47/4f/474f7861a373700e675deea527d017ce/pa/BU16200_6743c2fe443c3df45db8fc664d63853e.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:11:00 [auto1.nl] INFO: Found listing with ID: AX77318
2026-03-27 12:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AX77318%27 HTTP/1.1" 200 None
2026-03-27 12:11:00 [auto1.nl] INFO: Scrape type for AX77318: 2
2026-03-27 12:11:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e36018dc-477d-588c-b069-15495730ef95 with identifier: AX77318
2026-03-27 12:11:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e36018dc-477d-588c-b069-15495730ef95 with scrape type 2
2026-03-27 12:11:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e36018dc-477d-588c-b069-15495730ef95 with scrape type 2
2026-03-27 12:11:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: e36018dc-477d-588c-b069-15495730ef95, identifier: AX77318
2026-03-27 12:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge5%252Fa6%252Fe5a6f672b5b54a745a2c201beb29b33b%252Fpa%252FZZ76935_f7a8293bb58aa57eea06f69828dfa6e5.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:11:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/a6/e5a6f672b5b54a745a2c201beb29b33b/pa/ZZ76935_f7a8293bb58aa57eea06f69828dfa6e5.jpg not downloaded yet
2026-03-27 12:11:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: cfff64aa-bf53-54ac-a935-97ce27e75a3b with identifier: AE06801
2026-03-27 12:11:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: cfff64aa-bf53-54ac-a935-97ce27e75a3b with identifier: AE06801
2026-03-27 12:11:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: cfff64aa-bf53-54ac-a935-97ce27e75a3b with identifier: AE06801 to the API
2026-03-27 12:11:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 12:11:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 12:11:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-28T16:24:56Z',
 'fuel_type': 'diesel',
 'id': 'cfff64aa-bf53-54ac-a935-97ce27e75a3b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AE06801',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Vivaro',
 'odometer': 114628,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-03-21',
 'seller_name': None,
 'title': 'Opel Vivaro 1.6 Biturbo CDTI Kasten L2H1 2,9t',
 'transmission': 'manual',
 'trim': 'Kasten L2H1 2,9t',
 'year': 2017}
2026-03-27 12:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AE06801%27 HTTP/1.1" 200 None
2026-03-27 12:11:00 [auto1.nl] INFO: Saving data for AE06801: {'auction_closing_time': 1774715096.0, 'created_time': 1773301378.278136, 'last_price_update_time': 1774613460.56429}
2026-03-27 12:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='AE06801') HTTP/1.1" 204 0
2026-03-27 12:11:00 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 12:11:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: e36018dc-477d-588c-b069-15495730ef95 with identifier: AX77318
2026-03-27 12:11:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: e36018dc-477d-588c-b069-15495730ef95 with identifier: AX77318
2026-03-27 12:11:00 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: e36018dc-477d-588c-b069-15495730ef95 with identifier: AX77318 to the API
2026-03-27 12:11:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 12:11:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 12:11:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 98,
 'expiration_date': '2026-03-28T16:27:29Z',
 'fuel_type': 'petrol',
 'id': 'e36018dc-477d-588c-b069-15495730ef95',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AX77318',
 'listing': 'auction',
 'make': 'MINI',
 'model': 'Countryman',
 'odometer': 92848,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-05-03',
 'seller_name': None,
 'title': 'MINI Countryman One',
 'transmission': 'manual',
 'trim': '',
 'year': 2016}
2026-03-27 12:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AX77318%27 HTTP/1.1" 200 None
2026-03-27 12:11:00 [auto1.nl] INFO: Saving data for AX77318: {'auction_closing_time': 1774715249.0, 'created_time': 1774465827.65284, 'last_price_update_time': 1774613460.925793}
2026-03-27 12:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='AX77318') HTTP/1.1" 204 0
2026-03-27 12:11:00 [auto1.nl] INFO: Found listing with ID: VR09113
2026-03-27 12:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VR09113%27 HTTP/1.1" 200 None
2026-03-27 12:11:00 [auto1.nl] INFO: Scrape type for VR09113: 1
2026-03-27 12:11:00 [auto1.nl] INFO: Found listing with ID: FR61201
2026-03-27 12:11:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FR61201%27 HTTP/1.1" 200 None
2026-03-27 12:11:01 [auto1.nl] INFO: Scrape type for FR61201: 2
2026-03-27 12:11:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 89c28401-a63c-572a-a6f8-20b7567a2d9c with identifier: FR61201
2026-03-27 12:11:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 89c28401-a63c-572a-a6f8-20b7567a2d9c with scrape type 2
2026-03-27 12:11:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 89c28401-a63c-572a-a6f8-20b7567a2d9c with scrape type 2
2026-03-27 12:11:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 89c28401-a63c-572a-a6f8-20b7567a2d9c, identifier: FR61201
2026-03-27 12:11:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img68/c4/68c4f8ed3c358c3ecbaf57f5db9f31fa/pa/WU34213_44e73149d703c0254adb6722ead56e9d.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:11:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img47/4f/474f7861a373700e675deea527d017ce/pa/BU16200_9474b838eef89ba9eb16339c58d6de85.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:11:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 89c28401-a63c-572a-a6f8-20b7567a2d9c with identifier: FR61201
2026-03-27 12:11:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 89c28401-a63c-572a-a6f8-20b7567a2d9c with identifier: FR61201
2026-03-27 12:11:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 89c28401-a63c-572a-a6f8-20b7567a2d9c with identifier: FR61201 to the API
2026-03-27 12:11:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 12:11:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 12:11:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 258,
 'expiration_date': '2026-03-28T16:56:21Z',
 'fuel_type': 'petrol',
 'id': '89c28401-a63c-572a-a6f8-20b7567a2d9c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FR61201',
 'listing': 'auction',
 'make': 'BMW',
 'model': '6er',
 'odometer': 145022,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-09-13',
 'seller_name': None,
 'title': 'BMW 6er 630i GT M Sport',
 'transmission': 'automatic',
 'trim': 'M Sport',
 'year': 2018}
2026-03-27 12:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FR61201%27 HTTP/1.1" 200 None
2026-03-27 12:11:01 [auto1.nl] INFO: Saving data for FR61201: {'auction_closing_time': 1774716981.0, 'created_time': 1773302367.371782, 'last_price_update_time': 1774613461.420067}
2026-03-27 12:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='FR61201') HTTP/1.1" 204 0
2026-03-27 12:11:01 [auto1.nl] INFO: Found listing with ID: CC90793
2026-03-27 12:11:01 [auto1.nl] INFO: Found listing with ID: MW03156
2026-03-27 12:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MW03156%27 HTTP/1.1" 200 None
2026-03-27 12:11:01 [auto1.nl] INFO: Scrape type for MW03156: 2
2026-03-27 12:11:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 42fb4e30-a8ac-5e51-9b32-a0d25768c890 with identifier: MW03156
2026-03-27 12:11:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 42fb4e30-a8ac-5e51-9b32-a0d25768c890 with scrape type 2
2026-03-27 12:11:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 42fb4e30-a8ac-5e51-9b32-a0d25768c890 with scrape type 2
2026-03-27 12:11:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 42fb4e30-a8ac-5e51-9b32-a0d25768c890, identifier: MW03156
2026-03-27 12:11:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img31/e9/31e93b4b2f1af9e4c69d29706eaf09e9/pa/NY57976_20cc6b735d6f2056e4a15f802e8791e8.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:11:01 [auto1.nl] INFO: Found listing with ID: ZP69271
2026-03-27 12:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZP69271%27 HTTP/1.1" 200 None
2026-03-27 12:11:01 [auto1.nl] INFO: Scrape type for ZP69271: 2
2026-03-27 12:11:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c2a0c88c-cd3b-5216-a731-7031ed886f19 with identifier: ZP69271
2026-03-27 12:11:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c2a0c88c-cd3b-5216-a731-7031ed886f19 with scrape type 2
2026-03-27 12:11:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c2a0c88c-cd3b-5216-a731-7031ed886f19 with scrape type 2
2026-03-27 12:11:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: c2a0c88c-cd3b-5216-a731-7031ed886f19, identifier: ZP69271
2026-03-27 12:11:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 42fb4e30-a8ac-5e51-9b32-a0d25768c890 with identifier: MW03156
2026-03-27 12:11:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 42fb4e30-a8ac-5e51-9b32-a0d25768c890 with identifier: MW03156
2026-03-27 12:11:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 42fb4e30-a8ac-5e51-9b32-a0d25768c890 with identifier: MW03156 to the API
2026-03-27 12:11:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 12:11:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 12:11:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 102,
 'expiration_date': '2026-03-28T16:17:04Z',
 'fuel_type': 'petrol',
 'id': '42fb4e30-a8ac-5e51-9b32-a0d25768c890',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MW03156',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Octavia',
 'odometer': 163375,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2004-06-29',
 'seller_name': None,
 'title': 'Skoda Octavia 1.6 Ambiente',
 'transmission': 'manual',
 'trim': 'Ambiente',
 'year': 2004}
2026-03-27 12:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MW03156%27 HTTP/1.1" 200 None
2026-03-27 12:11:02 [auto1.nl] INFO: Saving data for MW03156: {'auction_closing_time': 1774714624.0, 'created_time': 1774095097.615821, 'last_price_update_time': 1774613462.098684}
2026-03-27 12:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='MW03156') HTTP/1.1" 204 0
2026-03-27 12:11:02 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 12:11:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:11:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7cfe10db50>
2026-03-27 12:11:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:11:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:11:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:11:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7c40c185-843e-5d61-911e-4bee8fe9d413/7c40c185-843e-5d61-911e-4bee8fe9d413_image_5.jpg HTTP/1.1" 201 0
2026-03-27 12:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg31%252Fe9%252F31e93b4b2f1af9e4c69d29706eaf09e9%252Fpa%252FNY57976_34775b390ebd47f7978c99024117ae6e.jpg') HTTP/1.1" 204 0
2026-03-27 12:11:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/e9/31e93b4b2f1af9e4c69d29706eaf09e9/pa/NY57976_34775b390ebd47f7978c99024117ae6e.jpg saved to cache
2026-03-27 12:11:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 7c40c185-843e-5d61-911e-4bee8fe9d413
2026-03-27 12:11:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:11:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7cfdfdef10>
2026-03-27 12:11:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:11:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:11:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:11:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_77737d54-e208-58bd-b23d-d89e6e2f3656/77737d54-e208-58bd-b23d-d89e6e2f3656_image_6.jpg HTTP/1.1" 201 0
2026-03-27 12:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg68%252Fc4%252F68c4f8ed3c358c3ecbaf57f5db9f31fa%252Fpa%252FWU34213_2d7eef1f2416e6c9e2b386f2f975573f.jpg') HTTP/1.1" 204 0
2026-03-27 12:11:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/c4/68c4f8ed3c358c3ecbaf57f5db9f31fa/pa/WU34213_2d7eef1f2416e6c9e2b386f2f975573f.jpg saved to cache
2026-03-27 12:11:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 77737d54-e208-58bd-b23d-d89e6e2f3656
2026-03-27 12:11:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:11:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7cfcd13810>
2026-03-27 12:11:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:11:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:11:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:11:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a1d476b6-ca15-5b1b-b633-eafb1a6a0d81/a1d476b6-ca15-5b1b-b633-eafb1a6a0d81_image_5.jpg HTTP/1.1" 201 0
2026-03-27 12:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252F4f%252F474f7861a373700e675deea527d017ce%252Fpa%252FBU16200_6743c2fe443c3df45db8fc664d63853e.jpg') HTTP/1.1" 204 0
2026-03-27 12:11:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/4f/474f7861a373700e675deea527d017ce/pa/BU16200_6743c2fe443c3df45db8fc664d63853e.jpg saved to cache
2026-03-27 12:11:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a1d476b6-ca15-5b1b-b633-eafb1a6a0d81
2026-03-27 12:11:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: c2a0c88c-cd3b-5216-a731-7031ed886f19 with identifier: ZP69271
2026-03-27 12:11:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: c2a0c88c-cd3b-5216-a731-7031ed886f19 with identifier: ZP69271
2026-03-27 12:11:02 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: c2a0c88c-cd3b-5216-a731-7031ed886f19 with identifier: ZP69271 to the API
2026-03-27 12:11:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 12:11:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 12:11:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-28T16:33:11Z',
 'fuel_type': 'diesel',
 'id': 'c2a0c88c-cd3b-5216-a731-7031ed886f19',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZP69271',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'V40',
 'odometer': 237750,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-10-14',
 'seller_name': None,
 'title': 'Volvo V40 1.6 D2 R-Design',
 'transmission': 'manual',
 'trim': 'R-Design',
 'year': 2013}
2026-03-27 12:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZP69271%27 HTTP/1.1" 200 None
2026-03-27 12:11:02 [auto1.nl] INFO: Saving data for ZP69271: {'auction_closing_time': 1774715591.0, 'created_time': 1773343026.850206, 'last_price_update_time': 1774613462.696785}
2026-03-27 12:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='ZP69271') HTTP/1.1" 204 0
2026-03-27 12:11:02 [auto1.nl] INFO: Found listing with ID: FY76730
2026-03-27 12:11:02 [auto1.nl] INFO: Found listing with ID: WG27101
2026-03-27 12:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WG27101%27 HTTP/1.1" 200 None
2026-03-27 12:11:02 [auto1.nl] INFO: Scrape type for WG27101: 2
2026-03-27 12:11:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b7ec511d-8f63-59d9-a2c7-8607bb3bfe7f with identifier: WG27101
2026-03-27 12:11:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b7ec511d-8f63-59d9-a2c7-8607bb3bfe7f with scrape type 2
2026-03-27 12:11:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b7ec511d-8f63-59d9-a2c7-8607bb3bfe7f with scrape type 2
2026-03-27 12:11:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: b7ec511d-8f63-59d9-a2c7-8607bb3bfe7f, identifier: WG27101
2026-03-27 12:11:02 [auto1.nl] INFO: Found listing with ID: FB46775
2026-03-27 12:11:02 [auto1.nl] INFO: Found listing with ID: LG18300
2026-03-27 12:11:02 [auto1.nl] INFO: Found listing with ID: FX92385
2026-03-27 12:11:02 [auto1.nl] INFO: Found listing with ID: JA96094
2026-03-27 12:11:02 [auto1.nl] INFO: Found listing with ID: YB51800
2026-03-27 12:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YB51800%27 HTTP/1.1" 200 None
2026-03-27 12:11:02 [auto1.nl] INFO: Scrape type for YB51800: 2
2026-03-27 12:11:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e7ff8dcd-66f0-506a-bdae-d97b95d3b837 with identifier: YB51800
2026-03-27 12:11:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e7ff8dcd-66f0-506a-bdae-d97b95d3b837 with scrape type 2
2026-03-27 12:11:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e7ff8dcd-66f0-506a-bdae-d97b95d3b837 with scrape type 2
2026-03-27 12:11:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: e7ff8dcd-66f0-506a-bdae-d97b95d3b837, identifier: YB51800
2026-03-27 12:11:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: b7ec511d-8f63-59d9-a2c7-8607bb3bfe7f with identifier: WG27101
2026-03-27 12:11:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: b7ec511d-8f63-59d9-a2c7-8607bb3bfe7f with identifier: WG27101
2026-03-27 12:11:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: b7ec511d-8f63-59d9-a2c7-8607bb3bfe7f with identifier: WG27101 to the API
2026-03-27 12:11:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 12:11:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 12:11:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 185,
 'expiration_date': '2026-03-28T16:23:11Z',
 'fuel_type': 'petrol',
 'id': 'b7ec511d-8f63-59d9-a2c7-8607bb3bfe7f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WG27101',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 226784,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-01-05',
 'seller_name': None,
 'title': 'BMW 3er 320i GT',
 'transmission': 'manual',
 'trim': '',
 'year': 2015}
2026-03-27 12:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WG27101%27 HTTP/1.1" 200 None
2026-03-27 12:11:03 [auto1.nl] INFO: Saving data for WG27101: {'auction_closing_time': 1774714991.0, 'created_time': 1773301517.942438, 'last_price_update_time': 1774613463.269655}
2026-03-27 12:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='WG27101') HTTP/1.1" 204 0
2026-03-27 12:11:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:11:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7cfe0cde50>
2026-03-27 12:11:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:11:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:11:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:11:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_77737d54-e208-58bd-b23d-d89e6e2f3656/77737d54-e208-58bd-b23d-d89e6e2f3656_image_7.jpg HTTP/1.1" 201 0
2026-03-27 12:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg68%252Fc4%252F68c4f8ed3c358c3ecbaf57f5db9f31fa%252Fpa%252FWU34213_44e73149d703c0254adb6722ead56e9d.jpg') HTTP/1.1" 204 0
2026-03-27 12:11:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/c4/68c4f8ed3c358c3ecbaf57f5db9f31fa/pa/WU34213_44e73149d703c0254adb6722ead56e9d.jpg saved to cache
2026-03-27 12:11:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 77737d54-e208-58bd-b23d-d89e6e2f3656
2026-03-27 12:11:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:11:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7cfdf12c90>
2026-03-27 12:11:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:11:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:11:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:11:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a1d476b6-ca15-5b1b-b633-eafb1a6a0d81/a1d476b6-ca15-5b1b-b633-eafb1a6a0d81_image_7.jpg HTTP/1.1" 201 0
2026-03-27 12:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252F4f%252F474f7861a373700e675deea527d017ce%252Fpa%252FBU16200_9474b838eef89ba9eb16339c58d6de85.jpg') HTTP/1.1" 204 0
2026-03-27 12:11:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/4f/474f7861a373700e675deea527d017ce/pa/BU16200_9474b838eef89ba9eb16339c58d6de85.jpg saved to cache
2026-03-27 12:11:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a1d476b6-ca15-5b1b-b633-eafb1a6a0d81
2026-03-27 12:11:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img47/4f/474f7861a373700e675deea527d017ce/pa/BU16200_db29f35b9517301b585265ca4d830b77.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:11:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img31/e9/31e93b4b2f1af9e4c69d29706eaf09e9/pa/NY57976_7d5972a26306d6729efa2c42da1a25cb.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:11:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: e7ff8dcd-66f0-506a-bdae-d97b95d3b837 with identifier: YB51800
2026-03-27 12:11:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: e7ff8dcd-66f0-506a-bdae-d97b95d3b837 with identifier: YB51800
2026-03-27 12:11:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: e7ff8dcd-66f0-506a-bdae-d97b95d3b837 with identifier: YB51800 to the API
2026-03-27 12:11:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 12:11:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 12:11:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-28T16:03:54Z',
 'fuel_type': 'petrol',
 'id': 'e7ff8dcd-66f0-506a-bdae-d97b95d3b837',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YB51800',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Kadjar',
 'odometer': 197308,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-08-28',
 'seller_name': None,
 'title': 'Renault Kadjar 1.2 TCe Energy Intens',
 'transmission': 'manual',
 'trim': 'Intens',
 'year': 2018}
2026-03-27 12:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YB51800%27 HTTP/1.1" 200 None
2026-03-27 12:11:03 [auto1.nl] INFO: Saving data for YB51800: {'auction_closing_time': 1774713834.0, 'created_time': 1773515440.741206, 'last_price_update_time': 1774613463.699818}
2026-03-27 12:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='YB51800') HTTP/1.1" 204 0
2026-03-27 12:11:03 [auto1.nl] INFO: Found listing with ID: AX06352
2026-03-27 12:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AX06352%27 HTTP/1.1" 200 None
2026-03-27 12:11:03 [auto1.nl] INFO: Scrape type for AX06352: 2
2026-03-27 12:11:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3457c2fc-3ceb-56de-821f-c366bb033387 with identifier: AX06352
2026-03-27 12:11:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3457c2fc-3ceb-56de-821f-c366bb033387 with scrape type 2
2026-03-27 12:11:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3457c2fc-3ceb-56de-821f-c366bb033387 with scrape type 2
2026-03-27 12:11:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 3457c2fc-3ceb-56de-821f-c366bb033387, identifier: AX06352
2026-03-27 12:11:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:11:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7cfcd0bbd0>
2026-03-27 12:11:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:11:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:11:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:11:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7c40c185-843e-5d61-911e-4bee8fe9d413/7c40c185-843e-5d61-911e-4bee8fe9d413_image_7.jpg HTTP/1.1" 201 0
2026-03-27 12:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg31%252Fe9%252F31e93b4b2f1af9e4c69d29706eaf09e9%252Fpa%252FNY57976_20cc6b735d6f2056e4a15f802e8791e8.jpg') HTTP/1.1" 204 0
2026-03-27 12:11:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/e9/31e93b4b2f1af9e4c69d29706eaf09e9/pa/NY57976_20cc6b735d6f2056e4a15f802e8791e8.jpg saved to cache
2026-03-27 12:11:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 7c40c185-843e-5d61-911e-4bee8fe9d413
2026-03-27 12:11:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img68/c4/68c4f8ed3c358c3ecbaf57f5db9f31fa/pa/WU34213_78802cd21f5faa0271471db712d05f73.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:11:03 [auto1.nl] INFO: Found listing with ID: XV01386
2026-03-27 12:11:03 [auto1.nl] INFO: Found listing with ID: DH84557
2026-03-27 12:11:03 [auto1.nl] INFO: Found listing with ID: WS29354
2026-03-27 12:11:03 [auto1.nl] INFO: Found listing with ID: CT81231
2026-03-27 12:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CT81231%27 HTTP/1.1" 200 None
2026-03-27 12:11:03 [auto1.nl] INFO: Scrape type for CT81231: 1
2026-03-27 12:11:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 3457c2fc-3ceb-56de-821f-c366bb033387 with identifier: AX06352
2026-03-27 12:11:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 3457c2fc-3ceb-56de-821f-c366bb033387 with identifier: AX06352
2026-03-27 12:11:03 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 3457c2fc-3ceb-56de-821f-c366bb033387 with identifier: AX06352 to the API
2026-03-27 12:11:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 12:11:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 12:11:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-28T16:56:03Z',
 'fuel_type': 'diesel',
 'id': '3457c2fc-3ceb-56de-821f-c366bb033387',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AX06352',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'NV200 Evalia',
 'odometer': 222877,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-01-03',
 'seller_name': None,
 'title': 'Nissan NV200 Evalia 1.5 dCi Kasten Comfort',
 'transmission': 'manual',
 'trim': 'Kasten Comfort',
 'year': 2011}
2026-03-27 12:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AX06352%27 HTTP/1.1" 200 None
2026-03-27 12:11:04 [auto1.nl] INFO: Saving data for AX06352: {'auction_closing_time': 1774716963.0, 'created_time': 1774268081.306856, 'last_price_update_time': 1774613464.191288}
2026-03-27 12:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='AX06352') HTTP/1.1" 204 0
2026-03-27 12:11:04 [auto1.nl] INFO: Found listing with ID: SL12489
2026-03-27 12:11:04 [auto1.nl] INFO: Found listing with ID: YE50957
2026-03-27 12:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YE50957%27 HTTP/1.1" 200 None
2026-03-27 12:11:04 [auto1.nl] INFO: Scrape type for YE50957: 1
2026-03-27 12:11:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img47/4f/474f7861a373700e675deea527d017ce/pa/BU16200_800245c2175d2abdf4b72ae0ea2a3e6d.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:11:04 [auto1.nl] INFO: Found listing with ID: JN77730
2026-03-27 12:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JN77730%27 HTTP/1.1" 200 None
2026-03-27 12:11:04 [auto1.nl] INFO: Scrape type for JN77730: 2
2026-03-27 12:11:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a11c3c1f-aac5-54eb-a602-5c6217d1cbb5 with identifier: JN77730
2026-03-27 12:11:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a11c3c1f-aac5-54eb-a602-5c6217d1cbb5 with scrape type 2
2026-03-27 12:11:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a11c3c1f-aac5-54eb-a602-5c6217d1cbb5 with scrape type 2
2026-03-27 12:11:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: a11c3c1f-aac5-54eb-a602-5c6217d1cbb5, identifier: JN77730
2026-03-27 12:11:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 12:11:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img31/e9/31e93b4b2f1af9e4c69d29706eaf09e9/pa/NY57976_235b3d31703fb04f757eeaa34ef82044.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:11:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: a11c3c1f-aac5-54eb-a602-5c6217d1cbb5 with identifier: JN77730
2026-03-27 12:11:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: a11c3c1f-aac5-54eb-a602-5c6217d1cbb5 with identifier: JN77730
2026-03-27 12:11:04 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: a11c3c1f-aac5-54eb-a602-5c6217d1cbb5 with identifier: JN77730 to the API
2026-03-27 12:11:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 12:11:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 12:11:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-28T16:56:03Z',
 'fuel_type': 'petrol',
 'id': 'a11c3c1f-aac5-54eb-a602-5c6217d1cbb5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JN77730',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'A3 Sportback',
 'odometer': 228593,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-12-06',
 'seller_name': None,
 'title': 'Audi A3 Sportback 1.4 TFSI S line Sportpaket plus',
 'transmission': 'manual',
 'trim': 'S line Sportpaket plus',
 'year': 2012}
2026-03-27 12:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JN77730%27 HTTP/1.1" 200 None
2026-03-27 12:11:04 [auto1.nl] INFO: Saving data for JN77730: {'auction_closing_time': 1774716963.0, 'created_time': 1773749674.371386, 'last_price_update_time': 1774613464.766303}
2026-03-27 12:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='JN77730') HTTP/1.1" 204 0
2026-03-27 12:11:04 [auto1.nl] INFO: Found listing with ID: LJ95506
2026-03-27 12:11:04 [auto1.nl] INFO: Found listing with ID: CR43638
2026-03-27 12:11:04 [auto1.nl] INFO: Found listing with ID: ZD26534
2026-03-27 12:11:04 [auto1.nl] INFO: Found listing with ID: EU67961
2026-03-27 12:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EU67961%27 HTTP/1.1" 200 None
2026-03-27 12:11:04 [auto1.nl] INFO: Scrape type for EU67961: 2
2026-03-27 12:11:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 74959324-1a2f-505c-96c1-7657c4c75a9f with identifier: EU67961
2026-03-27 12:11:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 74959324-1a2f-505c-96c1-7657c4c75a9f with scrape type 2
2026-03-27 12:11:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 74959324-1a2f-505c-96c1-7657c4c75a9f with scrape type 2
2026-03-27 12:11:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 74959324-1a2f-505c-96c1-7657c4c75a9f, identifier: EU67961
2026-03-27 12:11:04 [auto1.nl] INFO: Found listing with ID: FS82995
2026-03-27 12:11:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 74959324-1a2f-505c-96c1-7657c4c75a9f with identifier: EU67961
2026-03-27 12:11:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 74959324-1a2f-505c-96c1-7657c4c75a9f with identifier: EU67961
2026-03-27 12:11:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 74959324-1a2f-505c-96c1-7657c4c75a9f with identifier: EU67961 to the API
2026-03-27 12:11:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 12:11:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 12:11:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-28T16:02:31Z',
 'fuel_type': 'petrol',
 'id': '74959324-1a2f-505c-96c1-7657c4c75a9f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EU67961',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C3 Picasso',
 'odometer': 186342,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-03-30',
 'seller_name': None,
 'title': 'Citroen C3 Picasso 1.6 VTi Tendance',
 'transmission': 'manual',
 'trim': 'Tendance',
 'year': 2011}
2026-03-27 12:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EU67961%27 HTTP/1.1" 200 None
2026-03-27 12:11:05 [auto1.nl] INFO: Saving data for EU67961: {'auction_closing_time': 1774713751.0, 'created_time': 1773688317.813995, 'last_price_update_time': 1774613465.212279}
2026-03-27 12:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='EU67961') HTTP/1.1" 204 0
2026-03-27 12:11:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 12:11:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:11:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7cfe10de50>
2026-03-27 12:11:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:11:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:11:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:11:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a1d476b6-ca15-5b1b-b633-eafb1a6a0d81/a1d476b6-ca15-5b1b-b633-eafb1a6a0d81_image_8.jpg HTTP/1.1" 201 0
2026-03-27 12:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252F4f%252F474f7861a373700e675deea527d017ce%252Fpa%252FBU16200_db29f35b9517301b585265ca4d830b77.jpg') HTTP/1.1" 204 0
2026-03-27 12:11:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/4f/474f7861a373700e675deea527d017ce/pa/BU16200_db29f35b9517301b585265ca4d830b77.jpg saved to cache
2026-03-27 12:11:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item a1d476b6-ca15-5b1b-b633-eafb1a6a0d81
2026-03-27 12:11:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:11:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7cfe07c6d0>
2026-03-27 12:11:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:11:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:11:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:11:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7c40c185-843e-5d61-911e-4bee8fe9d413/7c40c185-843e-5d61-911e-4bee8fe9d413_image_8.jpg HTTP/1.1" 201 0
2026-03-27 12:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg31%252Fe9%252F31e93b4b2f1af9e4c69d29706eaf09e9%252Fpa%252FNY57976_7d5972a26306d6729efa2c42da1a25cb.jpg') HTTP/1.1" 204 0
2026-03-27 12:11:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/e9/31e93b4b2f1af9e4c69d29706eaf09e9/pa/NY57976_7d5972a26306d6729efa2c42da1a25cb.jpg saved to cache
2026-03-27 12:11:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 7c40c185-843e-5d61-911e-4bee8fe9d413
2026-03-27 12:11:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:11:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7cfdf08510>
2026-03-27 12:11:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:11:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:11:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:11:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_77737d54-e208-58bd-b23d-d89e6e2f3656/77737d54-e208-58bd-b23d-d89e6e2f3656_image_8.jpg HTTP/1.1" 201 0
2026-03-27 12:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg68%252Fc4%252F68c4f8ed3c358c3ecbaf57f5db9f31fa%252Fpa%252FWU34213_78802cd21f5faa0271471db712d05f73.jpg') HTTP/1.1" 204 0
2026-03-27 12:11:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/c4/68c4f8ed3c358c3ecbaf57f5db9f31fa/pa/WU34213_78802cd21f5faa0271471db712d05f73.jpg saved to cache
2026-03-27 12:11:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 77737d54-e208-58bd-b23d-d89e6e2f3656
2026-03-27 12:11:05 [auto1.nl] INFO: Found listing with ID: LZ16255
2026-03-27 12:11:05 [auto1.nl] INFO: Found listing with ID: PK52304
2026-03-27 12:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PK52304%27 HTTP/1.1" 200 None
2026-03-27 12:11:05 [auto1.nl] INFO: Scrape type for PK52304: 1
2026-03-27 12:11:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge5/a6/e5a6f672b5b54a745a2c201beb29b33b/pa/ZZ76935_9fcafc5a140d5b5cb187e66bdedde984.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:11:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge5/a6/e5a6f672b5b54a745a2c201beb29b33b/pa/ZZ76935_e7e936fb5a723d404d5e22a1802e94ea.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:11:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:11:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7cfcdeadd0>
2026-03-27 12:11:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:11:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:11:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:11:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a1d476b6-ca15-5b1b-b633-eafb1a6a0d81/a1d476b6-ca15-5b1b-b633-eafb1a6a0d81_image_6.jpg HTTP/1.1" 201 0
2026-03-27 12:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252F4f%252F474f7861a373700e675deea527d017ce%252Fpa%252FBU16200_800245c2175d2abdf4b72ae0ea2a3e6d.jpg') HTTP/1.1" 204 0
2026-03-27 12:11:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/4f/474f7861a373700e675deea527d017ce/pa/BU16200_800245c2175d2abdf4b72ae0ea2a3e6d.jpg saved to cache
2026-03-27 12:11:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a1d476b6-ca15-5b1b-b633-eafb1a6a0d81
2026-03-27 12:11:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:11:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7cfeed7d10>
2026-03-27 12:11:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:11:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:11:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:11:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7c40c185-843e-5d61-911e-4bee8fe9d413/7c40c185-843e-5d61-911e-4bee8fe9d413_image_6.jpg HTTP/1.1" 201 0
2026-03-27 12:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg31%252Fe9%252F31e93b4b2f1af9e4c69d29706eaf09e9%252Fpa%252FNY57976_235b3d31703fb04f757eeaa34ef82044.jpg') HTTP/1.1" 204 0
2026-03-27 12:11:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/e9/31e93b4b2f1af9e4c69d29706eaf09e9/pa/NY57976_235b3d31703fb04f757eeaa34ef82044.jpg saved to cache
2026-03-27 12:11:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 7c40c185-843e-5d61-911e-4bee8fe9d413
2026-03-27 12:11:05 [auto1.nl] INFO: Found listing with ID: KV65945
2026-03-27 12:11:05 [auto1.nl] INFO: Found listing with ID: SY05694
2026-03-27 12:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SY05694%27 HTTP/1.1" 200 None
2026-03-27 12:11:05 [auto1.nl] INFO: Scrape type for SY05694: 2
2026-03-27 12:11:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c97aa07e-16f6-5199-bab2-4ee85e79a62e with identifier: SY05694
2026-03-27 12:11:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c97aa07e-16f6-5199-bab2-4ee85e79a62e with scrape type 2
2026-03-27 12:11:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c97aa07e-16f6-5199-bab2-4ee85e79a62e with scrape type 2
2026-03-27 12:11:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: c97aa07e-16f6-5199-bab2-4ee85e79a62e, identifier: SY05694
2026-03-27 12:11:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img68/c4/68c4f8ed3c358c3ecbaf57f5db9f31fa/pa/WU34213_c4774910cec564b255d564961aedf651.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:11:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: c97aa07e-16f6-5199-bab2-4ee85e79a62e with identifier: SY05694
2026-03-27 12:11:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: c97aa07e-16f6-5199-bab2-4ee85e79a62e with identifier: SY05694
2026-03-27 12:11:05 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: c97aa07e-16f6-5199-bab2-4ee85e79a62e with identifier: SY05694 to the API
2026-03-27 12:11:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 12:11:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 12:11:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-28T16:04:40Z',
 'fuel_type': 'petrol',
 'id': 'c97aa07e-16f6-5199-bab2-4ee85e79a62e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SY05694',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'A-Klasse',
 'odometer': 84161,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-10-12',
 'seller_name': None,
 'title': 'Mercedes-Benz A-Klasse A 180 BlueEfficiency Style',
 'transmission': 'automatic',
 'trim': 'BlueEfficiency Style',
 'year': 2016}
2026-03-27 12:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SY05694%27 HTTP/1.1" 200 None
2026-03-27 12:11:05 [auto1.nl] INFO: Saving data for SY05694: {'auction_closing_time': 1774713880.0, 'created_time': 1774379539.06068, 'last_price_update_time': 1774613465.993629}
2026-03-27 12:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='SY05694') HTTP/1.1" 204 0
2026-03-27 12:11:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 12:11:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge5/a6/e5a6f672b5b54a745a2c201beb29b33b/pa/ZZ76935_f7a8293bb58aa57eea06f69828dfa6e5.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:11:06 [auto1.nl] INFO: Found listing with ID: ZL63379
2026-03-27 12:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZL63379%27 HTTP/1.1" 200 None
2026-03-27 12:11:06 [auto1.nl] INFO: Scrape type for ZL63379: 2
2026-03-27 12:11:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7b266567-6345-5a83-bee7-618f3c719214 with identifier: ZL63379
2026-03-27 12:11:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7b266567-6345-5a83-bee7-618f3c719214 with scrape type 2
2026-03-27 12:11:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7b266567-6345-5a83-bee7-618f3c719214 with scrape type 2
2026-03-27 12:11:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 7b266567-6345-5a83-bee7-618f3c719214, identifier: ZL63379
2026-03-27 12:11:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img68/c4/68c4f8ed3c358c3ecbaf57f5db9f31fa/pa/WU34213_cf410d91f1d13bf6e26d9a67a686d414.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:11:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imge5/a6/e5a6f672b5b54a745a2c201beb29b33b/pa/ZZ76935_054ea0d12b9f605f81839d9f461589ef.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:11:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 7b266567-6345-5a83-bee7-618f3c719214 with identifier: ZL63379
2026-03-27 12:11:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 7b266567-6345-5a83-bee7-618f3c719214 with identifier: ZL63379
2026-03-27 12:11:06 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 7b266567-6345-5a83-bee7-618f3c719214 with identifier: ZL63379 to the API
2026-03-27 12:11:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 12:11:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 12:11:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 155,
 'expiration_date': '2026-03-28T16:42:11Z',
 'fuel_type': 'petrol',
 'id': '7b266567-6345-5a83-bee7-618f3c719214',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZL63379',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 99854,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-06-08',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 180 CGI AMG Line',
 'transmission': 'automatic',
 'trim': 'AMG Line',
 'year': 2017}
2026-03-27 12:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZL63379%27 HTTP/1.1" 200 None
2026-03-27 12:11:06 [auto1.nl] INFO: Saving data for ZL63379: {'auction_closing_time': 1774716131.0, 'created_time': 1774293145.040534, 'last_price_update_time': 1774613466.570241}
2026-03-27 12:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='ZL63379') HTTP/1.1" 204 0
2026-03-27 12:11:06 [auto1.nl] INFO: Found listing with ID: HH59485
2026-03-27 12:11:06 [auto1.nl] INFO: Found listing with ID: SW07946
2026-03-27 12:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SW07946%27 HTTP/1.1" 200 None
2026-03-27 12:11:06 [auto1.nl] INFO: Scrape type for SW07946: 1
2026-03-27 12:11:06 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 12:11:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:11:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7cfe17e810>
2026-03-27 12:11:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:11:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:11:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:11:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_de9ef2ce-dced-52e2-a8d9-ed0810e1cfdf/de9ef2ce-dced-52e2-a8d9-ed0810e1cfdf_image_2.jpg HTTP/1.1" 201 0
2026-03-27 12:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge5%252Fa6%252Fe5a6f672b5b54a745a2c201beb29b33b%252Fpa%252FZZ76935_9fcafc5a140d5b5cb187e66bdedde984.jpg') HTTP/1.1" 204 0
2026-03-27 12:11:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/a6/e5a6f672b5b54a745a2c201beb29b33b/pa/ZZ76935_9fcafc5a140d5b5cb187e66bdedde984.jpg saved to cache
2026-03-27 12:11:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item de9ef2ce-dced-52e2-a8d9-ed0810e1cfdf
2026-03-27 12:11:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:11:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7cfce68f50>
2026-03-27 12:11:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:11:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:11:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:11:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_de9ef2ce-dced-52e2-a8d9-ed0810e1cfdf/de9ef2ce-dced-52e2-a8d9-ed0810e1cfdf_image_1.jpg HTTP/1.1" 201 0
2026-03-27 12:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge5%252Fa6%252Fe5a6f672b5b54a745a2c201beb29b33b%252Fpa%252FZZ76935_e7e936fb5a723d404d5e22a1802e94ea.jpg') HTTP/1.1" 204 0
2026-03-27 12:11:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/a6/e5a6f672b5b54a745a2c201beb29b33b/pa/ZZ76935_e7e936fb5a723d404d5e22a1802e94ea.jpg saved to cache
2026-03-27 12:11:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item de9ef2ce-dced-52e2-a8d9-ed0810e1cfdf
2026-03-27 12:11:06 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 12:11:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:11:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7cfcdc4d90>
2026-03-27 12:11:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:11:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:11:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:11:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_77737d54-e208-58bd-b23d-d89e6e2f3656/77737d54-e208-58bd-b23d-d89e6e2f3656_image_0.jpg HTTP/1.1" 201 0
2026-03-27 12:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg68%252Fc4%252F68c4f8ed3c358c3ecbaf57f5db9f31fa%252Fpa%252FWU34213_c4774910cec564b255d564961aedf651.jpg') HTTP/1.1" 204 0
2026-03-27 12:11:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/c4/68c4f8ed3c358c3ecbaf57f5db9f31fa/pa/WU34213_c4774910cec564b255d564961aedf651.jpg saved to cache
2026-03-27 12:11:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 77737d54-e208-58bd-b23d-d89e6e2f3656
2026-03-27 12:11:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img31/e9/31e93b4b2f1af9e4c69d29706eaf09e9/pa/NY57976_da862e36c49265ec9d1ce82f97a5fdbe.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:11:06 [scrapy.extensions.logstats] INFO: Crawled 75 pages (at 75 pages/min), scraped 58 items (at 58 items/min)
2026-03-27 12:11:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 189MiB
2026-03-27 12:11:06 [auto1.nl] INFO: Found listing with ID: NF23683
2026-03-27 12:11:06 [auto1.nl] INFO: Found listing with ID: WH69219
2026-03-27 12:11:06 [auto1.nl] INFO: Found listing with ID: CK43593
2026-03-27 12:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CK43593%27 HTTP/1.1" 200 None
2026-03-27 12:11:06 [auto1.nl] INFO: Scrape type for CK43593: 2
2026-03-27 12:11:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 460e7c1b-55ba-5cb7-8b3b-97a5defd2595 with identifier: CK43593
2026-03-27 12:11:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 460e7c1b-55ba-5cb7-8b3b-97a5defd2595 with scrape type 2
2026-03-27 12:11:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 460e7c1b-55ba-5cb7-8b3b-97a5defd2595 with scrape type 2
2026-03-27 12:11:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 460e7c1b-55ba-5cb7-8b3b-97a5defd2595, identifier: CK43593
2026-03-27 12:11:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 12:11:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:11:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7cfe196990>
2026-03-27 12:11:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:11:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:11:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:11:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_de9ef2ce-dced-52e2-a8d9-ed0810e1cfdf/de9ef2ce-dced-52e2-a8d9-ed0810e1cfdf_image_3.jpg HTTP/1.1" 201 0
2026-03-27 12:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge5%252Fa6%252Fe5a6f672b5b54a745a2c201beb29b33b%252Fpa%252FZZ76935_f7a8293bb58aa57eea06f69828dfa6e5.jpg') HTTP/1.1" 204 0
2026-03-27 12:11:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/a6/e5a6f672b5b54a745a2c201beb29b33b/pa/ZZ76935_f7a8293bb58aa57eea06f69828dfa6e5.jpg saved to cache
2026-03-27 12:11:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item de9ef2ce-dced-52e2-a8d9-ed0810e1cfdf
2026-03-27 12:11:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:11:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7cfdf101d0>
2026-03-27 12:11:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:11:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:11:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:11:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_77737d54-e208-58bd-b23d-d89e6e2f3656/77737d54-e208-58bd-b23d-d89e6e2f3656_image_9.jpg HTTP/1.1" 201 0
2026-03-27 12:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg68%252Fc4%252F68c4f8ed3c358c3ecbaf57f5db9f31fa%252Fpa%252FWU34213_cf410d91f1d13bf6e26d9a67a686d414.jpg') HTTP/1.1" 204 0
2026-03-27 12:11:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img68/c4/68c4f8ed3c358c3ecbaf57f5db9f31fa/pa/WU34213_cf410d91f1d13bf6e26d9a67a686d414.jpg saved to cache
2026-03-27 12:11:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 77737d54-e208-58bd-b23d-d89e6e2f3656
2026-03-27 12:11:07 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 77737d54-e208-58bd-b23d-d89e6e2f3656, skipping ID generation
2026-03-27 12:11:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 77737d54-e208-58bd-b23d-d89e6e2f3656 with scrape type 1
2026-03-27 12:11:07 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 77737d54-e208-58bd-b23d-d89e6e2f3656 sending to next pipeline
2026-03-27 12:11:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 77737d54-e208-58bd-b23d-d89e6e2f3656, identifier: WU34213
2026-03-27 12:11:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:11:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7cfdf07990>
2026-03-27 12:11:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:11:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:11:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:11:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_de9ef2ce-dced-52e2-a8d9-ed0810e1cfdf/de9ef2ce-dced-52e2-a8d9-ed0810e1cfdf_image_0.jpg HTTP/1.1" 201 0
2026-03-27 12:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimge5%252Fa6%252Fe5a6f672b5b54a745a2c201beb29b33b%252Fpa%252FZZ76935_054ea0d12b9f605f81839d9f461589ef.jpg') HTTP/1.1" 204 0
2026-03-27 12:11:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/a6/e5a6f672b5b54a745a2c201beb29b33b/pa/ZZ76935_054ea0d12b9f605f81839d9f461589ef.jpg saved to cache
2026-03-27 12:11:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item de9ef2ce-dced-52e2-a8d9-ed0810e1cfdf
2026-03-27 12:11:07 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: de9ef2ce-dced-52e2-a8d9-ed0810e1cfdf, skipping ID generation
2026-03-27 12:11:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item de9ef2ce-dced-52e2-a8d9-ed0810e1cfdf with scrape type 1
2026-03-27 12:11:07 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item de9ef2ce-dced-52e2-a8d9-ed0810e1cfdf sending to next pipeline
2026-03-27 12:11:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: de9ef2ce-dced-52e2-a8d9-ed0810e1cfdf, identifier: ZZ76935
2026-03-27 12:11:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img47/4f/474f7861a373700e675deea527d017ce/pa/BU16200_af99ff4c908143fd4c48b4f98ff4a394.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:11:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 460e7c1b-55ba-5cb7-8b3b-97a5defd2595 with identifier: CK43593
2026-03-27 12:11:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 460e7c1b-55ba-5cb7-8b3b-97a5defd2595 with identifier: CK43593
2026-03-27 12:11:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 460e7c1b-55ba-5cb7-8b3b-97a5defd2595 with identifier: CK43593 to the API
2026-03-27 12:11:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 12:11:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 12:11:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 245,
 'expiration_date': '2026-03-28T16:36:00Z',
 'fuel_type': 'hybrid',
 'id': '460e7c1b-55ba-5cb7-8b3b-97a5defd2595',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CK43593',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q3 Sportback',
 'odometer': 83270,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-03-17',
 'seller_name': None,
 'title': 'Audi Q3 Sportback 45 TFSIe',
 'transmission': 'automatic',
 'trim': '',
 'year': 2021}
2026-03-27 12:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CK43593%27 HTTP/1.1" 200 None
2026-03-27 12:11:07 [auto1.nl] INFO: Saving data for CK43593: {'auction_closing_time': 1774715760.0, 'created_time': 1773861137.497922, 'last_price_update_time': 1774613467.616509}
2026-03-27 12:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='CK43593') HTTP/1.1" 204 0
2026-03-27 12:11:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/VR09113/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 12:11:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 77737d54-e208-58bd-b23d-d89e6e2f3656 with identifier: WU34213
2026-03-27 12:11:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 77737d54-e208-58bd-b23d-d89e6e2f3656 with identifier: WU34213
2026-03-27 12:11:07 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 77737d54-e208-58bd-b23d-d89e6e2f3656 with identifier: WU34213 to the API
2026-03-27 12:11:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 12:11:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 12:11:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img68/c4/68c4f8ed3c358c3ecbaf57f5db9f31fa/pa/WU34213_cf410d91f1d13bf6e26d9a67a686d414.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 5',
 'engine': '1.8L',
 'engine_horse_power': 160,
 'expiration_date': '2026-03-28T16:09:38Z',
 'fuel_type': 'petrol',
 'id': '77737d54-e208-58bd-b23d-d89e6e2f3656',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': '85SNN8',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WU34213',
 'listing': 'auction',
 'location': "NL, 's-Gravenzande",
 'make': 'Volkswagen',
 'model': 'Passat CC',
 'odometer': 218656,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_77737d54-e208-58bd-b23d-d89e6e2f3656/77737d54-e208-58bd-b23d-d89e6e2f3656_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2202055,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img68/c4/68c4f8ed3c358c3ecbaf57f5db9f31fa/pa/WU34213_c4774910cec564b255d564961aedf651.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_77737d54-e208-58bd-b23d-d89e6e2f3656/77737d54-e208-58bd-b23d-d89e6e2f3656_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60052,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img68/c4/68c4f8ed3c358c3ecbaf57f5db9f31fa/pa/WU34213_3ffe179694ee36cd9ee364d8ef4bd561.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_77737d54-e208-58bd-b23d-d89e6e2f3656/77737d54-e208-58bd-b23d-d89e6e2f3656_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63128,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img68/c4/68c4f8ed3c358c3ecbaf57f5db9f31fa/pa/WU34213_8cddec371edcdd5398494e52ebc998f6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_77737d54-e208-58bd-b23d-d89e6e2f3656/77737d54-e208-58bd-b23d-d89e6e2f3656_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63720,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img68/c4/68c4f8ed3c358c3ecbaf57f5db9f31fa/pa/WU34213_611af52499ff6e53f7c1b625e3424f10.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_77737d54-e208-58bd-b23d-d89e6e2f3656/77737d54-e208-58bd-b23d-d89e6e2f3656_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57359,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img68/c4/68c4f8ed3c358c3ecbaf57f5db9f31fa/pa/WU34213_1cdbaac3a343ac09274c58f81a8331da.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_77737d54-e208-58bd-b23d-d89e6e2f3656/77737d54-e208-58bd-b23d-d89e6e2f3656_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63477,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img68/c4/68c4f8ed3c358c3ecbaf57f5db9f31fa/pa/WU34213_c58c67b408aa72cc70e9231ef34b0f50.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_77737d54-e208-58bd-b23d-d89e6e2f3656/77737d54-e208-58bd-b23d-d89e6e2f3656_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65688,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img68/c4/68c4f8ed3c358c3ecbaf57f5db9f31fa/pa/WU34213_2d7eef1f2416e6c9e2b386f2f975573f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_77737d54-e208-58bd-b23d-d89e6e2f3656/77737d54-e208-58bd-b23d-d89e6e2f3656_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60126,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img68/c4/68c4f8ed3c358c3ecbaf57f5db9f31fa/pa/WU34213_44e73149d703c0254adb6722ead56e9d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_77737d54-e208-58bd-b23d-d89e6e2f3656/77737d54-e208-58bd-b23d-d89e6e2f3656_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70703,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img68/c4/68c4f8ed3c358c3ecbaf57f5db9f31fa/pa/WU34213_78802cd21f5faa0271471db712d05f73.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_77737d54-e208-58bd-b23d-d89e6e2f3656/77737d54-e208-58bd-b23d-d89e6e2f3656_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61091,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img68/c4/68c4f8ed3c358c3ecbaf57f5db9f31fa/pa/WU34213_cf410d91f1d13bf6e26d9a67a686d414.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2011-12-28',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volkswagen Passat CC 1.8 TSI',
 'transmission': 'automatic',
 'trim': '',
 'year': 2011}
2026-03-27 12:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WU34213%27 HTTP/1.1" 200 None
2026-03-27 12:11:08 [auto1.nl] INFO: Saving data for WU34213: {'created_time': 1774613468.031922, 'last_price_update_time': 1774613468.031999, 'auction_closing_time': 1774714178.0}
2026-03-27 12:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='WU34213') HTTP/1.1" 204 0
2026-03-27 12:11:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: de9ef2ce-dced-52e2-a8d9-ed0810e1cfdf with identifier: ZZ76935
2026-03-27 12:11:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: de9ef2ce-dced-52e2-a8d9-ed0810e1cfdf with identifier: ZZ76935
2026-03-27 12:11:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: de9ef2ce-dced-52e2-a8d9-ed0810e1cfdf with identifier: ZZ76935 to the API
2026-03-27 12:11:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 12:11:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 12:11:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imge5/a6/e5a6f672b5b54a745a2c201beb29b33b/pa/ZZ76935_054ea0d12b9f605f81839d9f461589ef.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 161,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '1.6L',
 'engine_horse_power': 105,
 'expiration_date': '2026-03-28T16:06:25Z',
 'fuel_type': 'petrol',
 'id': 'de9ef2ce-dced-52e2-a8d9-ed0810e1cfdf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': '85ZPTN',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZZ76935',
 'listing': 'auction',
 'location': 'NL, Groningen',
 'make': 'Opel',
 'model': 'Meriva',
 'odometer': 220382,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 4,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_de9ef2ce-dced-52e2-a8d9-ed0810e1cfdf/de9ef2ce-dced-52e2-a8d9-ed0810e1cfdf_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 108836,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge5/a6/e5a6f672b5b54a745a2c201beb29b33b/pa/ZZ76935_054ea0d12b9f605f81839d9f461589ef.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_de9ef2ce-dced-52e2-a8d9-ed0810e1cfdf/de9ef2ce-dced-52e2-a8d9-ed0810e1cfdf_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 106117,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge5/a6/e5a6f672b5b54a745a2c201beb29b33b/pa/ZZ76935_e7e936fb5a723d404d5e22a1802e94ea.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_de9ef2ce-dced-52e2-a8d9-ed0810e1cfdf/de9ef2ce-dced-52e2-a8d9-ed0810e1cfdf_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89426,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge5/a6/e5a6f672b5b54a745a2c201beb29b33b/pa/ZZ76935_9fcafc5a140d5b5cb187e66bdedde984.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_de9ef2ce-dced-52e2-a8d9-ed0810e1cfdf/de9ef2ce-dced-52e2-a8d9-ed0810e1cfdf_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65319,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge5/a6/e5a6f672b5b54a745a2c201beb29b33b/pa/ZZ76935_f7a8293bb58aa57eea06f69828dfa6e5.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2008-04-27',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Opel Meriva 1.6 Enjoy',
 'transmission': 'manual',
 'trim': 'Enjoy',
 'year': 2008}
2026-03-27 12:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZZ76935%27 HTTP/1.1" 200 None
2026-03-27 12:11:08 [auto1.nl] INFO: Saving data for ZZ76935: {'created_time': 1774613468.483994, 'last_price_update_time': 1774613468.484007, 'auction_closing_time': 1774713985.0}
2026-03-27 12:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='ZZ76935') HTTP/1.1" 204 0
2026-03-27 12:11:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img31/e9/31e93b4b2f1af9e4c69d29706eaf09e9/pa/NY57976_7cc1bc16efaa698ea5fd5ad82ea1ecaa.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:11:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img47/4f/474f7861a373700e675deea527d017ce/pa/BU16200_75706c46552ef61a3763de9f2ccefe68.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:11:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img47/4f/474f7861a373700e675deea527d017ce/pa/BU16200_dbc5ffb7f25f3bdaa5ce8fd50030d670.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:11:08 [auto1.nl] INFO: Found listing with ID: XG40529
2026-03-27 12:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XG40529%27 HTTP/1.1" 200 None
2026-03-27 12:11:08 [auto1.nl] INFO: Scrape type for XG40529: 2
2026-03-27 12:11:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7fe5f167-9d3a-5199-ab25-73b052b1dfa8 with identifier: XG40529
2026-03-27 12:11:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7fe5f167-9d3a-5199-ab25-73b052b1dfa8 with scrape type 2
2026-03-27 12:11:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7fe5f167-9d3a-5199-ab25-73b052b1dfa8 with scrape type 2
2026-03-27 12:11:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 7fe5f167-9d3a-5199-ab25-73b052b1dfa8, identifier: XG40529
2026-03-27 12:11:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgae/34/ae344a715587a9cce542943901610cdf/pa/DA49617_7c1acbec512436c35f1e476b5f20024e.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:11:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 7fe5f167-9d3a-5199-ab25-73b052b1dfa8 with identifier: XG40529
2026-03-27 12:11:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 7fe5f167-9d3a-5199-ab25-73b052b1dfa8 with identifier: XG40529
2026-03-27 12:11:08 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 7fe5f167-9d3a-5199-ab25-73b052b1dfa8 with identifier: XG40529 to the API
2026-03-27 12:11:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 12:11:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 12:11:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-28T16:49:58Z',
 'fuel_type': 'petrol',
 'id': '7fe5f167-9d3a-5199-ab25-73b052b1dfa8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/XG40529',
 'listing': 'auction',
 'make': 'Lancia',
 'model': 'Ypsilon',
 'odometer': 199270,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2004-05-16',
 'seller_name': None,
 'title': 'Lancia Ypsilon 1.4 Platino DFN',
 'transmission': 'automatic',
 'trim': 'Platino DFN',
 'year': 2004}
2026-03-27 12:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XG40529%27 HTTP/1.1" 200 None
2026-03-27 12:11:08 [auto1.nl] INFO: Saving data for XG40529: {'auction_closing_time': 1774716598.0, 'created_time': 1773429292.398222, 'last_price_update_time': 1774613468.957689}
2026-03-27 12:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='XG40529') HTTP/1.1" 204 0
2026-03-27 12:11:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/CT81231/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 12:11:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/YE50957/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 12:11:08 [auto1.nl] INFO: Channel: 24h | Page: 5 | totalHits: 1060 | hits on page: 40
2026-03-27 12:11:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:11:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7cfeed74d0>
2026-03-27 12:11:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:11:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:11:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:11:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7c40c185-843e-5d61-911e-4bee8fe9d413/7c40c185-843e-5d61-911e-4bee8fe9d413_image_9.jpg HTTP/1.1" 201 0
2026-03-27 12:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg31%252Fe9%252F31e93b4b2f1af9e4c69d29706eaf09e9%252Fpa%252FNY57976_da862e36c49265ec9d1ce82f97a5fdbe.jpg') HTTP/1.1" 204 0
2026-03-27 12:11:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/e9/31e93b4b2f1af9e4c69d29706eaf09e9/pa/NY57976_da862e36c49265ec9d1ce82f97a5fdbe.jpg saved to cache
2026-03-27 12:11:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 7c40c185-843e-5d61-911e-4bee8fe9d413
2026-03-27 12:11:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img31/e9/31e93b4b2f1af9e4c69d29706eaf09e9/pa/NY57976_988a0a8ad434a8f3e849c3921eb5593a.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:11:09 [auto1.nl] INFO: Found listing with ID: FR68688
2026-03-27 12:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FR68688%27 HTTP/1.1" 200 None
2026-03-27 12:11:09 [auto1.nl] INFO: Scrape type for FR68688: 1
2026-03-27 12:11:09 [auto1.nl] INFO: Found listing with ID: RM47540
2026-03-27 12:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RM47540%27 HTTP/1.1" 200 None
2026-03-27 12:11:09 [auto1.nl] INFO: Scrape type for RM47540: 2
2026-03-27 12:11:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c09a5f55-2a05-5deb-ade7-87a1bc21f2c0 with identifier: RM47540
2026-03-27 12:11:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c09a5f55-2a05-5deb-ade7-87a1bc21f2c0 with scrape type 2
2026-03-27 12:11:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c09a5f55-2a05-5deb-ade7-87a1bc21f2c0 with scrape type 2
2026-03-27 12:11:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: c09a5f55-2a05-5deb-ade7-87a1bc21f2c0, identifier: RM47540
2026-03-27 12:11:09 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 12:11:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:11:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7cfe0cde10>
2026-03-27 12:11:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:11:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:11:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:11:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a1d476b6-ca15-5b1b-b633-eafb1a6a0d81/a1d476b6-ca15-5b1b-b633-eafb1a6a0d81_image_1.jpg HTTP/1.1" 201 0
2026-03-27 12:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252F4f%252F474f7861a373700e675deea527d017ce%252Fpa%252FBU16200_af99ff4c908143fd4c48b4f98ff4a394.jpg') HTTP/1.1" 204 0
2026-03-27 12:11:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/4f/474f7861a373700e675deea527d017ce/pa/BU16200_af99ff4c908143fd4c48b4f98ff4a394.jpg saved to cache
2026-03-27 12:11:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a1d476b6-ca15-5b1b-b633-eafb1a6a0d81
2026-03-27 12:11:09 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 12:11:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:11:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7d00002bd0>
2026-03-27 12:11:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:11:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:11:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:11:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7c40c185-843e-5d61-911e-4bee8fe9d413/7c40c185-843e-5d61-911e-4bee8fe9d413_image_0.jpg HTTP/1.1" 201 0
2026-03-27 12:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg31%252Fe9%252F31e93b4b2f1af9e4c69d29706eaf09e9%252Fpa%252FNY57976_7cc1bc16efaa698ea5fd5ad82ea1ecaa.jpg') HTTP/1.1" 204 0
2026-03-27 12:11:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/e9/31e93b4b2f1af9e4c69d29706eaf09e9/pa/NY57976_7cc1bc16efaa698ea5fd5ad82ea1ecaa.jpg saved to cache
2026-03-27 12:11:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7c40c185-843e-5d61-911e-4bee8fe9d413
2026-03-27 12:11:09 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 12:11:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:11:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7cfe0a8590>
2026-03-27 12:11:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:11:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:11:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:11:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a1d476b6-ca15-5b1b-b633-eafb1a6a0d81/a1d476b6-ca15-5b1b-b633-eafb1a6a0d81_image_0.jpg HTTP/1.1" 201 0
2026-03-27 12:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252F4f%252F474f7861a373700e675deea527d017ce%252Fpa%252FBU16200_75706c46552ef61a3763de9f2ccefe68.jpg') HTTP/1.1" 204 0
2026-03-27 12:11:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/4f/474f7861a373700e675deea527d017ce/pa/BU16200_75706c46552ef61a3763de9f2ccefe68.jpg saved to cache
2026-03-27 12:11:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a1d476b6-ca15-5b1b-b633-eafb1a6a0d81
2026-03-27 12:11:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:11:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7cfccb90d0>
2026-03-27 12:11:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:11:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:11:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:11:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a1d476b6-ca15-5b1b-b633-eafb1a6a0d81/a1d476b6-ca15-5b1b-b633-eafb1a6a0d81_image_4.jpg HTTP/1.1" 201 0
2026-03-27 12:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252F4f%252F474f7861a373700e675deea527d017ce%252Fpa%252FBU16200_dbc5ffb7f25f3bdaa5ce8fd50030d670.jpg') HTTP/1.1" 204 0
2026-03-27 12:11:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/4f/474f7861a373700e675deea527d017ce/pa/BU16200_dbc5ffb7f25f3bdaa5ce8fd50030d670.jpg saved to cache
2026-03-27 12:11:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a1d476b6-ca15-5b1b-b633-eafb1a6a0d81
2026-03-27 12:11:09 [auto1.nl] INFO: Found listing with ID: HK90585
2026-03-27 12:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HK90585%27 HTTP/1.1" 200 None
2026-03-27 12:11:09 [auto1.nl] INFO: Scrape type for HK90585: 2
2026-03-27 12:11:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 14de2679-1d2d-5a57-997b-0f391724915e with identifier: HK90585
2026-03-27 12:11:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 14de2679-1d2d-5a57-997b-0f391724915e with scrape type 2
2026-03-27 12:11:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 14de2679-1d2d-5a57-997b-0f391724915e with scrape type 2
2026-03-27 12:11:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 14de2679-1d2d-5a57-997b-0f391724915e, identifier: HK90585
2026-03-27 12:11:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: c09a5f55-2a05-5deb-ade7-87a1bc21f2c0 with identifier: RM47540
2026-03-27 12:11:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: c09a5f55-2a05-5deb-ade7-87a1bc21f2c0 with identifier: RM47540
2026-03-27 12:11:09 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: c09a5f55-2a05-5deb-ade7-87a1bc21f2c0 with identifier: RM47540 to the API
2026-03-27 12:11:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 12:11:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 12:11:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 252,
 'expiration_date': '2026-03-28T16:56:24Z',
 'fuel_type': 'hybrid',
 'id': 'c09a5f55-2a05-5deb-ade7-87a1bc21f2c0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RM47540',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 199507,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-12-01',
 'seller_name': None,
 'title': 'BMW 3er 330e Sport Line',
 'transmission': 'automatic',
 'trim': 'Sport Line',
 'year': 2016}
2026-03-27 12:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RM47540%27 HTTP/1.1" 200 None
2026-03-27 12:11:09 [auto1.nl] INFO: Saving data for RM47540: {'auction_closing_time': 1774716984.0, 'created_time': 1773926989.972535, 'last_price_update_time': 1774613469.950902}
2026-03-27 12:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='RM47540') HTTP/1.1" 204 0
2026-03-27 12:11:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:11:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7cfe296250>
2026-03-27 12:11:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:11:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:11:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:11:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_51b97771-700f-5d91-a60b-59b108a49e15/51b97771-700f-5d91-a60b-59b108a49e15_image_4.jpg HTTP/1.1" 201 0
2026-03-27 12:11:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgae%252F34%252Fae344a715587a9cce542943901610cdf%252Fpa%252FDA49617_7c1acbec512436c35f1e476b5f20024e.jpg') HTTP/1.1" 204 0
2026-03-27 12:11:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgae/34/ae344a715587a9cce542943901610cdf/pa/DA49617_7c1acbec512436c35f1e476b5f20024e.jpg saved to cache
2026-03-27 12:11:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 51b97771-700f-5d91-a60b-59b108a49e15
2026-03-27 12:11:10 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 51b97771-700f-5d91-a60b-59b108a49e15, skipping ID generation
2026-03-27 12:11:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 51b97771-700f-5d91-a60b-59b108a49e15 with scrape type 1
2026-03-27 12:11:10 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 51b97771-700f-5d91-a60b-59b108a49e15 sending to next pipeline
2026-03-27 12:11:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 51b97771-700f-5d91-a60b-59b108a49e15, identifier: DA49617
2026-03-27 12:11:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img31/e9/31e93b4b2f1af9e4c69d29706eaf09e9/pa/NY57976_582c3ed868a655c309c83b92a22d358c.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:11:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 14de2679-1d2d-5a57-997b-0f391724915e with identifier: HK90585
2026-03-27 12:11:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 14de2679-1d2d-5a57-997b-0f391724915e with identifier: HK90585
2026-03-27 12:11:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 14de2679-1d2d-5a57-997b-0f391724915e with identifier: HK90585 to the API
2026-03-27 12:11:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 12:11:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 12:11:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:09:13Z',
 'fuel_type': 'diesel',
 'id': '14de2679-1d2d-5a57-997b-0f391724915e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HK90585',
 'listing': 'auction',
 'make': 'BMW',
 'model': '2er',
 'odometer': 194876,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-12-10',
 'seller_name': None,
 'title': 'BMW 2er 218d Gran Tourer',
 'transmission': 'manual',
 'trim': '',
 'year': 2015}
2026-03-27 12:11:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HK90585%27 HTTP/1.1" 200 None
2026-03-27 12:11:10 [auto1.nl] INFO: Saving data for HK90585: {'auction_closing_time': 1774714153.0, 'created_time': 1774293136.267029, 'last_price_update_time': 1774613470.417383}
2026-03-27 12:11:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='HK90585') HTTP/1.1" 204 0
2026-03-27 12:11:10 [auto1.nl] INFO: Found listing with ID: DZ87358
2026-03-27 12:11:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DZ87358%27 HTTP/1.1" 200 None
2026-03-27 12:11:10 [auto1.nl] INFO: Scrape type for DZ87358: 1
2026-03-27 12:11:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 51b97771-700f-5d91-a60b-59b108a49e15 with identifier: DA49617
2026-03-27 12:11:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 51b97771-700f-5d91-a60b-59b108a49e15 with identifier: DA49617
2026-03-27 12:11:10 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 51b97771-700f-5d91-a60b-59b108a49e15 with identifier: DA49617 to the API
2026-03-27 12:11:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 12:11:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 12:11:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgae/34/ae344a715587a9cce542943901610cdf/pa/DA49617_7c1acbec512436c35f1e476b5f20024e.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 5',
 'engine': '1.6L',
 'engine_horse_power': 75,
 'expiration_date': '2026-03-28T16:02:06Z',
 'fuel_type': 'diesel',
 'id': '51b97771-700f-5d91-a60b-59b108a49e15',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': '6-VVX-47',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DA49617',
 'listing': 'auction',
 'location': 'NL, Tradein',
 'make': 'Citroen',
 'model': 'Berlingo',
 'odometer': 266522,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_51b97771-700f-5d91-a60b-59b108a49e15/51b97771-700f-5d91-a60b-59b108a49e15_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80977,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgae/34/ae344a715587a9cce542943901610cdf/pa/DA49617_0e3c3d4b143ac940b154af1430b4d0d9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_51b97771-700f-5d91-a60b-59b108a49e15/51b97771-700f-5d91-a60b-59b108a49e15_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64873,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgae/34/ae344a715587a9cce542943901610cdf/pa/DA49617_d2196b5dd48731d600b684ac659836b2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_51b97771-700f-5d91-a60b-59b108a49e15/51b97771-700f-5d91-a60b-59b108a49e15_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74171,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgae/34/ae344a715587a9cce542943901610cdf/pa/DA49617_9d5b84ec1c1a8ee411b7b720554c9f35.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_51b97771-700f-5d91-a60b-59b108a49e15/51b97771-700f-5d91-a60b-59b108a49e15_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62449,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgae/34/ae344a715587a9cce542943901610cdf/pa/DA49617_8977fbde6e94281221f451b0387fb75c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_51b97771-700f-5d91-a60b-59b108a49e15/51b97771-700f-5d91-a60b-59b108a49e15_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65482,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgae/34/ae344a715587a9cce542943901610cdf/pa/DA49617_7c1acbec512436c35f1e476b5f20024e.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2012-06-07',
 'seats_number': 3,
 'seller_name': None,
 'title': 'Citroen Berlingo 1.6 HDi Niveau B L1',
 'transmission': 'manual',
 'trim': 'Niveau B L1',
 'year': 2012}
2026-03-27 12:11:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DA49617%27 HTTP/1.1" 200 None
2026-03-27 12:11:10 [auto1.nl] INFO: Saving data for DA49617: {'created_time': 1774613470.801728, 'last_price_update_time': 1774613470.801743, 'auction_closing_time': 1774713726.0}
2026-03-27 12:11:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='DA49617') HTTP/1.1" 204 0
2026-03-27 12:11:11 [auto1.nl] INFO: Found listing with ID: ZX63291
2026-03-27 12:11:11 [auto1.nl] INFO: Found listing with ID: BG94378
2026-03-27 12:11:11 [auto1.nl] INFO: Found listing with ID: CR31925
2026-03-27 12:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CR31925%27 HTTP/1.1" 200 None
2026-03-27 12:11:11 [auto1.nl] INFO: Scrape type for CR31925: 2
2026-03-27 12:11:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e8423ee1-8d09-5c80-a8df-ebb9725d2cb6 with identifier: CR31925
2026-03-27 12:11:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e8423ee1-8d09-5c80-a8df-ebb9725d2cb6 with scrape type 2
2026-03-27 12:11:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e8423ee1-8d09-5c80-a8df-ebb9725d2cb6 with scrape type 2
2026-03-27 12:11:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: e8423ee1-8d09-5c80-a8df-ebb9725d2cb6, identifier: CR31925
2026-03-27 12:11:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:11:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7cfce53110>
2026-03-27 12:11:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:11:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:11:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:11:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7c40c185-843e-5d61-911e-4bee8fe9d413/7c40c185-843e-5d61-911e-4bee8fe9d413_image_4.jpg HTTP/1.1" 201 0
2026-03-27 12:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg31%252Fe9%252F31e93b4b2f1af9e4c69d29706eaf09e9%252Fpa%252FNY57976_988a0a8ad434a8f3e849c3921eb5593a.jpg') HTTP/1.1" 204 0
2026-03-27 12:11:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/e9/31e93b4b2f1af9e4c69d29706eaf09e9/pa/NY57976_988a0a8ad434a8f3e849c3921eb5593a.jpg saved to cache
2026-03-27 12:11:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 7c40c185-843e-5d61-911e-4bee8fe9d413
2026-03-27 12:11:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: e8423ee1-8d09-5c80-a8df-ebb9725d2cb6 with identifier: CR31925
2026-03-27 12:11:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: e8423ee1-8d09-5c80-a8df-ebb9725d2cb6 with identifier: CR31925
2026-03-27 12:11:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: e8423ee1-8d09-5c80-a8df-ebb9725d2cb6 with identifier: CR31925 to the API
2026-03-27 12:11:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 12:11:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 12:11:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 204,
 'expiration_date': '2026-03-28T16:38:48Z',
 'fuel_type': 'hybrid',
 'id': 'e8423ee1-8d09-5c80-a8df-ebb9725d2cb6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CR31925',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 198921,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-08-09',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 1.4 GTE',
 'transmission': 'automatic',
 'trim': '',
 'year': 2015}
2026-03-27 12:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CR31925%27 HTTP/1.1" 200 None
2026-03-27 12:11:11 [auto1.nl] INFO: Saving data for CR31925: {'auction_closing_time': 1774715928.0, 'created_time': 1773688307.528593, 'last_price_update_time': 1774613471.463828}
2026-03-27 12:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='CR31925') HTTP/1.1" 204 0
2026-03-27 12:11:11 [auto1.nl] INFO: Found listing with ID: GN29290
2026-03-27 12:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GN29290%27 HTTP/1.1" 200 None
2026-03-27 12:11:11 [auto1.nl] INFO: Scrape type for GN29290: 1
2026-03-27 12:11:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/PK52304/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 12:11:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 12:11:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 12:11:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 12:11:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 12:11:11 [auto1.nl] INFO: Found listing with ID: BM13348
2026-03-27 12:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BM13348%27 HTTP/1.1" 200 None
2026-03-27 12:11:11 [auto1.nl] INFO: Scrape type for BM13348: 1
2026-03-27 12:11:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 12:11:11 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 12:11:11 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 12:11:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:11:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7cfe1f9690>
2026-03-27 12:11:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:11:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:11:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:11:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7c40c185-843e-5d61-911e-4bee8fe9d413/7c40c185-843e-5d61-911e-4bee8fe9d413_image_2.jpg HTTP/1.1" 201 0
2026-03-27 12:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg31%252Fe9%252F31e93b4b2f1af9e4c69d29706eaf09e9%252Fpa%252FNY57976_582c3ed868a655c309c83b92a22d358c.jpg') HTTP/1.1" 204 0
2026-03-27 12:11:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img31/e9/31e93b4b2f1af9e4c69d29706eaf09e9/pa/NY57976_582c3ed868a655c309c83b92a22d358c.jpg saved to cache
2026-03-27 12:11:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 7c40c185-843e-5d61-911e-4bee8fe9d413
2026-03-27 12:11:11 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7c40c185-843e-5d61-911e-4bee8fe9d413, skipping ID generation
2026-03-27 12:11:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7c40c185-843e-5d61-911e-4bee8fe9d413 with scrape type 1
2026-03-27 12:11:11 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7c40c185-843e-5d61-911e-4bee8fe9d413 sending to next pipeline
2026-03-27 12:11:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 7c40c185-843e-5d61-911e-4bee8fe9d413, identifier: NY57976
2026-03-27 12:11:11 [auto1.nl] INFO: Found listing with ID: DN96174
2026-03-27 12:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DN96174%27 HTTP/1.1" 200 None
2026-03-27 12:11:11 [auto1.nl] INFO: Scrape type for DN96174: 2
2026-03-27 12:11:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: eec40764-0309-5557-b786-0425ed702cb4 with identifier: DN96174
2026-03-27 12:11:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item eec40764-0309-5557-b786-0425ed702cb4 with scrape type 2
2026-03-27 12:11:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item eec40764-0309-5557-b786-0425ed702cb4 with scrape type 2
2026-03-27 12:11:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: eec40764-0309-5557-b786-0425ed702cb4, identifier: DN96174
2026-03-27 12:11:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 7c40c185-843e-5d61-911e-4bee8fe9d413 with identifier: NY57976
2026-03-27 12:11:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 7c40c185-843e-5d61-911e-4bee8fe9d413 with identifier: NY57976
2026-03-27 12:11:11 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 7c40c185-843e-5d61-911e-4bee8fe9d413 with identifier: NY57976 to the API
2026-03-27 12:11:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 12:11:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 12:11:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img31/e9/31e93b4b2f1af9e4c69d29706eaf09e9/pa/NY57976_582c3ed868a655c309c83b92a22d358c.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 85,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '2.0L',
 'engine_horse_power': 190,
 'expiration_date': '2026-03-28T16:18:43Z',
 'fuel_type': 'diesel',
 'id': '7c40c185-843e-5d61-911e-4bee8fe9d413',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': '6XFG57',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NY57976',
 'listing': 'auction',
 'location': 'NL, Zwolle',
 'make': 'Volvo',
 'model': 'V40',
 'odometer': 275928,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7c40c185-843e-5d61-911e-4bee8fe9d413/7c40c185-843e-5d61-911e-4bee8fe9d413_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2623755,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img31/e9/31e93b4b2f1af9e4c69d29706eaf09e9/pa/NY57976_7cc1bc16efaa698ea5fd5ad82ea1ecaa.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7c40c185-843e-5d61-911e-4bee8fe9d413/7c40c185-843e-5d61-911e-4bee8fe9d413_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63207,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img31/e9/31e93b4b2f1af9e4c69d29706eaf09e9/pa/NY57976_ebe98eda2cdb98d37056036f7d4009a3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7c40c185-843e-5d61-911e-4bee8fe9d413/7c40c185-843e-5d61-911e-4bee8fe9d413_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2656889,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img31/e9/31e93b4b2f1af9e4c69d29706eaf09e9/pa/NY57976_582c3ed868a655c309c83b92a22d358c.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7c40c185-843e-5d61-911e-4bee8fe9d413/7c40c185-843e-5d61-911e-4bee8fe9d413_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64290,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img31/e9/31e93b4b2f1af9e4c69d29706eaf09e9/pa/NY57976_9dd9faa5d8950e30a02bfc35d16a7487.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7c40c185-843e-5d61-911e-4bee8fe9d413/7c40c185-843e-5d61-911e-4bee8fe9d413_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68323,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img31/e9/31e93b4b2f1af9e4c69d29706eaf09e9/pa/NY57976_988a0a8ad434a8f3e849c3921eb5593a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7c40c185-843e-5d61-911e-4bee8fe9d413/7c40c185-843e-5d61-911e-4bee8fe9d413_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70982,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img31/e9/31e93b4b2f1af9e4c69d29706eaf09e9/pa/NY57976_34775b390ebd47f7978c99024117ae6e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7c40c185-843e-5d61-911e-4bee8fe9d413/7c40c185-843e-5d61-911e-4bee8fe9d413_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74409,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img31/e9/31e93b4b2f1af9e4c69d29706eaf09e9/pa/NY57976_235b3d31703fb04f757eeaa34ef82044.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7c40c185-843e-5d61-911e-4bee8fe9d413/7c40c185-843e-5d61-911e-4bee8fe9d413_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70337,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img31/e9/31e93b4b2f1af9e4c69d29706eaf09e9/pa/NY57976_20cc6b735d6f2056e4a15f802e8791e8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7c40c185-843e-5d61-911e-4bee8fe9d413/7c40c185-843e-5d61-911e-4bee8fe9d413_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59703,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img31/e9/31e93b4b2f1af9e4c69d29706eaf09e9/pa/NY57976_7d5972a26306d6729efa2c42da1a25cb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7c40c185-843e-5d61-911e-4bee8fe9d413/7c40c185-843e-5d61-911e-4bee8fe9d413_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67502,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img31/e9/31e93b4b2f1af9e4c69d29706eaf09e9/pa/NY57976_da862e36c49265ec9d1ce82f97a5fdbe.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2014-07-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Volvo V40 2.0 D4 Momentum',
 'transmission': 'manual',
 'trim': 'Momentum',
 'year': 2014}
2026-03-27 12:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NY57976%27 HTTP/1.1" 200 None
2026-03-27 12:11:12 [auto1.nl] INFO: Saving data for NY57976: {'created_time': 1774613472.164299, 'last_price_update_time': 1774613472.164311, 'auction_closing_time': 1774714723.0}
2026-03-27 12:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='NY57976') HTTP/1.1" 204 0
2026-03-27 12:11:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 12:11:12 [auto1.nl] INFO: Found listing with ID: ZZ44063
2026-03-27 12:11:12 [auto1.nl] INFO: Found listing with ID: FP18275
2026-03-27 12:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FP18275%27 HTTP/1.1" 200 None
2026-03-27 12:11:12 [auto1.nl] INFO: Scrape type for FP18275: 1
2026-03-27 12:11:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: eec40764-0309-5557-b786-0425ed702cb4 with identifier: DN96174
2026-03-27 12:11:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: eec40764-0309-5557-b786-0425ed702cb4 with identifier: DN96174
2026-03-27 12:11:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: eec40764-0309-5557-b786-0425ed702cb4 with identifier: DN96174 to the API
2026-03-27 12:11:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 12:11:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 12:11:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 220,
 'expiration_date': '2026-03-28T16:26:47Z',
 'fuel_type': 'petrol',
 'id': 'eec40764-0309-5557-b786-0425ed702cb4',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DN96174',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Clio',
 'odometer': 133526,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-06-09',
 'seller_name': None,
 'title': 'Renault Clio 1.6 TCe Renault Sport Trophy',
 'transmission': 'automatic',
 'trim': 'Sport Trophy',
 'year': 2016}
2026-03-27 12:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DN96174%27 HTTP/1.1" 200 None
2026-03-27 12:11:12 [auto1.nl] INFO: Saving data for DN96174: {'auction_closing_time': 1774715207.0, 'created_time': 1773924417.172091, 'last_price_update_time': 1774613472.518833}
2026-03-27 12:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='DN96174') HTTP/1.1" 204 0
2026-03-27 12:11:12 [auto1.nl] INFO: Found listing with ID: TU10821
2026-03-27 12:11:12 [auto1.nl] INFO: Found listing with ID: BG27703
2026-03-27 12:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BG27703%27 HTTP/1.1" 200 None
2026-03-27 12:11:12 [auto1.nl] INFO: Scrape type for BG27703: 1
2026-03-27 12:11:12 [auto1.nl] INFO: Found listing with ID: DK51310
2026-03-27 12:11:12 [auto1.nl] INFO: Found listing with ID: BV58634
2026-03-27 12:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BV58634%27 HTTP/1.1" 200 None
2026-03-27 12:11:12 [auto1.nl] INFO: Scrape type for BV58634: 1
2026-03-27 12:11:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SW07946/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 12:11:12 [auto1.nl] INFO: Found listing with ID: EB00697
2026-03-27 12:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EB00697%27 HTTP/1.1" 200 None
2026-03-27 12:11:12 [auto1.nl] INFO: Scrape type for EB00697: 1
2026-03-27 12:11:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 12:11:12 [auto1.nl] INFO: Found listing with ID: MD45251
2026-03-27 12:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MD45251%27 HTTP/1.1" 200 None
2026-03-27 12:11:12 [auto1.nl] INFO: Scrape type for MD45251: 1
2026-03-27 12:11:12 [auto1.nl] INFO: Found listing with ID: ET49040
2026-03-27 12:11:12 [auto1.nl] INFO: Found listing with ID: HX39878
2026-03-27 12:11:12 [auto1.nl] INFO: Found listing with ID: ES69537
2026-03-27 12:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ES69537%27 HTTP/1.1" 200 None
2026-03-27 12:11:12 [auto1.nl] INFO: Scrape type for ES69537: 1
2026-03-27 12:11:12 [auto1.nl] INFO: Found listing with ID: ZC66376
2026-03-27 12:11:12 [auto1.nl] INFO: Found listing with ID: WY03082
2026-03-27 12:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WY03082%27 HTTP/1.1" 200 None
2026-03-27 12:11:12 [auto1.nl] INFO: Scrape type for WY03082: 1
2026-03-27 12:11:12 [auto1.nl] INFO: Found listing with ID: NH69771
2026-03-27 12:11:12 [auto1.nl] INFO: Found listing with ID: CJ41969
2026-03-27 12:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CJ41969%27 HTTP/1.1" 200 None
2026-03-27 12:11:12 [auto1.nl] INFO: Scrape type for CJ41969: 2
2026-03-27 12:11:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 989cd8af-4413-519c-8a53-52c650ff5aaf with identifier: CJ41969
2026-03-27 12:11:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 989cd8af-4413-519c-8a53-52c650ff5aaf with scrape type 2
2026-03-27 12:11:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 989cd8af-4413-519c-8a53-52c650ff5aaf with scrape type 2
2026-03-27 12:11:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 989cd8af-4413-519c-8a53-52c650ff5aaf, identifier: CJ41969
2026-03-27 12:11:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 989cd8af-4413-519c-8a53-52c650ff5aaf with identifier: CJ41969
2026-03-27 12:11:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 989cd8af-4413-519c-8a53-52c650ff5aaf with identifier: CJ41969
2026-03-27 12:11:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 989cd8af-4413-519c-8a53-52c650ff5aaf with identifier: CJ41969 to the API
2026-03-27 12:11:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 12:11:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 12:11:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-28T16:30:03Z',
 'fuel_type': 'diesel',
 'id': '989cd8af-4413-519c-8a53-52c650ff5aaf',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CJ41969',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Touran',
 'odometer': 175739,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-03-13',
 'seller_name': None,
 'title': 'Volkswagen Touran 1.6 TDI Life BlueMotion',
 'transmission': 'manual',
 'trim': 'Life BlueMotion',
 'year': 2014}
2026-03-27 12:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CJ41969%27 HTTP/1.1" 200 None
2026-03-27 12:11:13 [auto1.nl] INFO: Saving data for CJ41969: {'auction_closing_time': 1774715403.0, 'created_time': 1773342965.438828, 'last_price_update_time': 1774613473.086969}
2026-03-27 12:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='CJ41969') HTTP/1.1" 204 0
2026-03-27 12:11:13 [auto1.nl] INFO: Found listing with ID: UF96545
2026-03-27 12:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UF96545%27 HTTP/1.1" 200 None
2026-03-27 12:11:13 [auto1.nl] INFO: Scrape type for UF96545: 1
2026-03-27 12:11:13 [auto1.nl] INFO: Found listing with ID: MT73533
2026-03-27 12:11:13 [auto1.nl] INFO: Found listing with ID: GL61326
2026-03-27 12:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GL61326%27 HTTP/1.1" 200 None
2026-03-27 12:11:13 [auto1.nl] INFO: Scrape type for GL61326: 1
2026-03-27 12:11:13 [auto1.nl] INFO: Found listing with ID: ZY76952
2026-03-27 12:11:13 [auto1.nl] INFO: Found listing with ID: BZ34461
2026-03-27 12:11:13 [auto1.nl] INFO: Found listing with ID: SY10793
2026-03-27 12:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SY10793%27 HTTP/1.1" 200 None
2026-03-27 12:11:13 [auto1.nl] INFO: Scrape type for SY10793: 1
2026-03-27 12:11:13 [auto1.nl] INFO: Found listing with ID: TY61758
2026-03-27 12:11:13 [auto1.nl] INFO: Found listing with ID: ZK51232
2026-03-27 12:11:13 [auto1.nl] INFO: Found listing with ID: EY85081
2026-03-27 12:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EY85081%27 HTTP/1.1" 200 None
2026-03-27 12:11:13 [auto1.nl] INFO: Scrape type for EY85081: 1
2026-03-27 12:11:13 [auto1.nl] INFO: Found listing with ID: ML03692
2026-03-27 12:11:13 [auto1.nl] INFO: Found listing with ID: NV42843
2026-03-27 12:11:13 [auto1.nl] INFO: Found listing with ID: RP15329
2026-03-27 12:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RP15329%27 HTTP/1.1" 200 None
2026-03-27 12:11:13 [auto1.nl] INFO: Scrape type for RP15329: 2
2026-03-27 12:11:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e6e36aaa-9465-5f90-b367-9e8c15905c1d with identifier: RP15329
2026-03-27 12:11:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e6e36aaa-9465-5f90-b367-9e8c15905c1d with scrape type 2
2026-03-27 12:11:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e6e36aaa-9465-5f90-b367-9e8c15905c1d with scrape type 2
2026-03-27 12:11:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: e6e36aaa-9465-5f90-b367-9e8c15905c1d, identifier: RP15329
2026-03-27 12:11:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: e6e36aaa-9465-5f90-b367-9e8c15905c1d with identifier: RP15329
2026-03-27 12:11:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: e6e36aaa-9465-5f90-b367-9e8c15905c1d with identifier: RP15329
2026-03-27 12:11:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: e6e36aaa-9465-5f90-b367-9e8c15905c1d with identifier: RP15329 to the API
2026-03-27 12:11:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 12:11:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 12:11:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-28T16:33:38Z',
 'fuel_type': 'petrol',
 'id': 'e6e36aaa-9465-5f90-b367-9e8c15905c1d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RP15329',
 'listing': 'auction',
 'make': 'BMW',
 'model': '3er',
 'odometer': 182578,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2002-12-12',
 'seller_name': None,
 'title': 'BMW 3er 316ti',
 'transmission': 'manual',
 'trim': '',
 'year': 2002}
2026-03-27 12:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RP15329%27 HTTP/1.1" 200 None
2026-03-27 12:11:13 [auto1.nl] INFO: Saving data for RP15329: {'auction_closing_time': 1774715618.0, 'created_time': 1773663987.605195, 'last_price_update_time': 1774613473.724371}
2026-03-27 12:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='RP15329') HTTP/1.1" 204 0
2026-03-27 12:11:13 [auto1.nl] INFO: Found listing with ID: GK86118
2026-03-27 12:11:13 [auto1.nl] INFO: Found listing with ID: AG89497
2026-03-27 12:11:13 [auto1.nl] INFO: Found listing with ID: TB82163
2026-03-27 12:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TB82163%27 HTTP/1.1" 200 None
2026-03-27 12:11:13 [auto1.nl] INFO: Scrape type for TB82163: 0
2026-03-27 12:11:13 [auto1.nl] INFO: Found listing with ID: BZ17478
2026-03-27 12:11:13 [auto1.nl] INFO: Found listing with ID: UB73502
2026-03-27 12:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UB73502%27 HTTP/1.1" 200 None
2026-03-27 12:11:13 [auto1.nl] INFO: Scrape type for UB73502: 0
2026-03-27 12:11:13 [auto1.nl] INFO: Found listing with ID: GZ48867
2026-03-27 12:11:13 [auto1.nl] INFO: Found listing with ID: GB93242
2026-03-27 12:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GB93242%27 HTTP/1.1" 200 None
2026-03-27 12:11:13 [auto1.nl] INFO: Scrape type for GB93242: 0
2026-03-27 12:11:13 [auto1.nl] INFO: Found listing with ID: BZ05855
2026-03-27 12:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BZ05855%27 HTTP/1.1" 200 None
2026-03-27 12:11:13 [auto1.nl] INFO: Scrape type for BZ05855: 0
2026-03-27 12:11:13 [auto1.nl] INFO: Found listing with ID: EM54492
2026-03-27 12:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EM54492%27 HTTP/1.1" 200 None
2026-03-27 12:11:13 [auto1.nl] INFO: Scrape type for EM54492: 0
2026-03-27 12:11:13 [auto1.nl] INFO: Found listing with ID: JG11787
2026-03-27 12:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JG11787%27 HTTP/1.1" 200 None
2026-03-27 12:11:13 [auto1.nl] INFO: Scrape type for JG11787: 0
2026-03-27 12:11:13 [auto1.nl] INFO: Found listing with ID: LA33547
2026-03-27 12:11:13 [auto1.nl] INFO: Found listing with ID: MU80357
2026-03-27 12:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MU80357%27 HTTP/1.1" 200 None
2026-03-27 12:11:13 [auto1.nl] INFO: Scrape type for MU80357: 0
2026-03-27 12:11:13 [auto1.nl] INFO: Found listing with ID: FT93592
2026-03-27 12:11:13 [auto1.nl] INFO: Found listing with ID: MU53685
2026-03-27 12:11:13 [auto1.nl] INFO: Found listing with ID: BH50437
2026-03-27 12:11:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FR68688/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 12:11:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 12:11:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img47/4f/474f7861a373700e675deea527d017ce/pa/BU16200_19b6a5f76a129af85e32e0ba8ec72533.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:11:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/VR09113> (referer: https://www.auto1.com/v1/car-details-view/VR09113/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 12:11:13 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 12:11:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/YE50957> (referer: https://www.auto1.com/v1/car-details-view/YE50957/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 12:11:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 12:11:14 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 12:11:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:11:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7cfe003450>
2026-03-27 12:11:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:11:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:11:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:11:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a1d476b6-ca15-5b1b-b633-eafb1a6a0d81/a1d476b6-ca15-5b1b-b633-eafb1a6a0d81_image_9.jpg HTTP/1.1" 201 0
2026-03-27 12:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg47%252F4f%252F474f7861a373700e675deea527d017ce%252Fpa%252FBU16200_19b6a5f76a129af85e32e0ba8ec72533.jpg') HTTP/1.1" 204 0
2026-03-27 12:11:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img47/4f/474f7861a373700e675deea527d017ce/pa/BU16200_19b6a5f76a129af85e32e0ba8ec72533.jpg saved to cache
2026-03-27 12:11:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item a1d476b6-ca15-5b1b-b633-eafb1a6a0d81
2026-03-27 12:11:14 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a1d476b6-ca15-5b1b-b633-eafb1a6a0d81, skipping ID generation
2026-03-27 12:11:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a1d476b6-ca15-5b1b-b633-eafb1a6a0d81 with scrape type 1
2026-03-27 12:11:14 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a1d476b6-ca15-5b1b-b633-eafb1a6a0d81 sending to next pipeline
2026-03-27 12:11:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: a1d476b6-ca15-5b1b-b633-eafb1a6a0d81, identifier: BU16200
2026-03-27 12:11:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: a1d476b6-ca15-5b1b-b633-eafb1a6a0d81 with identifier: BU16200
2026-03-27 12:11:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: a1d476b6-ca15-5b1b-b633-eafb1a6a0d81 with identifier: BU16200
2026-03-27 12:11:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: a1d476b6-ca15-5b1b-b633-eafb1a6a0d81 with identifier: BU16200 to the API
2026-03-27 12:11:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 12:11:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 12:11:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img47/4f/474f7861a373700e675deea527d017ce/pa/BU16200_19b6a5f76a129af85e32e0ba8ec72533.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'engine_horse_power': 125,
 'expiration_date': '2026-03-28T16:27:18Z',
 'fuel_type': 'petrol',
 'id': 'a1d476b6-ca15-5b1b-b633-eafb1a6a0d81',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'P553bk',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BU16200',
 'listing': 'auction',
 'location': 'NL, Amersfoort',
 'make': 'Ford',
 'model': 'EcoSport',
 'odometer': 25962,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a1d476b6-ca15-5b1b-b633-eafb1a6a0d81/a1d476b6-ca15-5b1b-b633-eafb1a6a0d81_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2665618,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img47/4f/474f7861a373700e675deea527d017ce/pa/BU16200_75706c46552ef61a3763de9f2ccefe68.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a1d476b6-ca15-5b1b-b633-eafb1a6a0d81/a1d476b6-ca15-5b1b-b633-eafb1a6a0d81_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2545240,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img47/4f/474f7861a373700e675deea527d017ce/pa/BU16200_af99ff4c908143fd4c48b4f98ff4a394.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a1d476b6-ca15-5b1b-b633-eafb1a6a0d81/a1d476b6-ca15-5b1b-b633-eafb1a6a0d81_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68094,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img47/4f/474f7861a373700e675deea527d017ce/pa/BU16200_df499e026ee5905574e17356299b5e29.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a1d476b6-ca15-5b1b-b633-eafb1a6a0d81/a1d476b6-ca15-5b1b-b633-eafb1a6a0d81_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 37100,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img47/4f/474f7861a373700e675deea527d017ce/pa/BU16200_20f60c172bd6b06c908d9b2b9bb36547.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a1d476b6-ca15-5b1b-b633-eafb1a6a0d81/a1d476b6-ca15-5b1b-b633-eafb1a6a0d81_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57181,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img47/4f/474f7861a373700e675deea527d017ce/pa/BU16200_dbc5ffb7f25f3bdaa5ce8fd50030d670.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a1d476b6-ca15-5b1b-b633-eafb1a6a0d81/a1d476b6-ca15-5b1b-b633-eafb1a6a0d81_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69221,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img47/4f/474f7861a373700e675deea527d017ce/pa/BU16200_6743c2fe443c3df45db8fc664d63853e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a1d476b6-ca15-5b1b-b633-eafb1a6a0d81/a1d476b6-ca15-5b1b-b633-eafb1a6a0d81_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 45130,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img47/4f/474f7861a373700e675deea527d017ce/pa/BU16200_800245c2175d2abdf4b72ae0ea2a3e6d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a1d476b6-ca15-5b1b-b633-eafb1a6a0d81/a1d476b6-ca15-5b1b-b633-eafb1a6a0d81_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61803,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img47/4f/474f7861a373700e675deea527d017ce/pa/BU16200_9474b838eef89ba9eb16339c58d6de85.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a1d476b6-ca15-5b1b-b633-eafb1a6a0d81/a1d476b6-ca15-5b1b-b633-eafb1a6a0d81_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 61309,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img47/4f/474f7861a373700e675deea527d017ce/pa/BU16200_db29f35b9517301b585265ca4d830b77.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a1d476b6-ca15-5b1b-b633-eafb1a6a0d81/a1d476b6-ca15-5b1b-b633-eafb1a6a0d81_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2829194,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img47/4f/474f7861a373700e675deea527d017ce/pa/BU16200_19b6a5f76a129af85e32e0ba8ec72533.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-01-08',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Ford EcoSport 1.0 EcoBoost Titanium Business',
 'transmission': 'automatic',
 'trim': 'Titanium Business',
 'year': 2019}
2026-03-27 12:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BU16200%27 HTTP/1.1" 200 None
2026-03-27 12:11:14 [auto1.nl] INFO: Saving data for BU16200: {'created_time': 1774613474.66408, 'last_price_update_time': 1774613474.664091, 'auction_closing_time': 1774715238.0}
2026-03-27 12:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='BU16200') HTTP/1.1" 204 0
2026-03-27 12:11:14 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 12:11:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GN29290/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 12:11:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BM13348/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 12:11:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 12:11:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 12:11:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 12:11:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 04fa97e3-66df-50cc-9db9-719167ae7290 with identifier: VR09113
2026-03-27 12:11:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 04fa97e3-66df-50cc-9db9-719167ae7290 with scrape type 1
2026-03-27 12:11:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 04fa97e3-66df-50cc-9db9-719167ae7290
2026-03-27 12:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg90%252F37%252F90377e89054aec82b78f8f0d7341bad6%252Fpa%252FVR09113_39afb7c476779ddb94742adca934bb54.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:11:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/37/90377e89054aec82b78f8f0d7341bad6/pa/VR09113_39afb7c476779ddb94742adca934bb54.jpg already downloaded
2026-03-27 12:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg90%252F37%252F90377e89054aec82b78f8f0d7341bad6%252Fpa%252FVR09113_ee54419969b1511051fc1d91a3712c7c.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:11:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/37/90377e89054aec82b78f8f0d7341bad6/pa/VR09113_ee54419969b1511051fc1d91a3712c7c.jpg already downloaded
2026-03-27 12:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg90%252F37%252F90377e89054aec82b78f8f0d7341bad6%252Fpa%252FVR09113_3d36f3f5b63ffbab18435064cd052520.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:11:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/37/90377e89054aec82b78f8f0d7341bad6/pa/VR09113_3d36f3f5b63ffbab18435064cd052520.jpg already downloaded
2026-03-27 12:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg90%252F37%252F90377e89054aec82b78f8f0d7341bad6%252Fpa%252FVR09113_f50ee903b1298bedf3539abfacbe61bb.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:11:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/37/90377e89054aec82b78f8f0d7341bad6/pa/VR09113_f50ee903b1298bedf3539abfacbe61bb.jpg already downloaded
2026-03-27 12:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg90%252F37%252F90377e89054aec82b78f8f0d7341bad6%252Fpa%252FVR09113_f70e484849a274a1bb36312aca754add.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:11:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/37/90377e89054aec82b78f8f0d7341bad6/pa/VR09113_f70e484849a274a1bb36312aca754add.jpg already downloaded
2026-03-27 12:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg90%252F37%252F90377e89054aec82b78f8f0d7341bad6%252Fpa%252FVR09113_8557fbd98da350c76dd17bb2d5b6ed55.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:11:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/37/90377e89054aec82b78f8f0d7341bad6/pa/VR09113_8557fbd98da350c76dd17bb2d5b6ed55.jpg already downloaded
2026-03-27 12:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg90%252F37%252F90377e89054aec82b78f8f0d7341bad6%252Fpa%252FVR09113_208dde48647eb5e9abd51dcf098e0f15.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:11:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/37/90377e89054aec82b78f8f0d7341bad6/pa/VR09113_208dde48647eb5e9abd51dcf098e0f15.jpg already downloaded
2026-03-27 12:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg90%252F37%252F90377e89054aec82b78f8f0d7341bad6%252Fpa%252FVR09113_7a4aa62bc86378d5960c634ec6734fe9.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:11:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/37/90377e89054aec82b78f8f0d7341bad6/pa/VR09113_7a4aa62bc86378d5960c634ec6734fe9.jpg already downloaded
2026-03-27 12:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg90%252F37%252F90377e89054aec82b78f8f0d7341bad6%252Fpa%252FVR09113_ffbafbd657175b4519c2f81e8b4ca638.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:11:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/37/90377e89054aec82b78f8f0d7341bad6/pa/VR09113_ffbafbd657175b4519c2f81e8b4ca638.jpg already downloaded
2026-03-27 12:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg90%252F37%252F90377e89054aec82b78f8f0d7341bad6%252Fpa%252FVR09113_a9a12dbda419e806679a8609fe589dd8.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:11:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img90/37/90377e89054aec82b78f8f0d7341bad6/pa/VR09113_a9a12dbda419e806679a8609fe589dd8.jpg already downloaded
2026-03-27 12:11:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 04fa97e3-66df-50cc-9db9-719167ae7290, identifier: VR09113
2026-03-27 12:11:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4c8de35b-ef90-5ef7-9bd4-77e49765b5df with identifier: YE50957
2026-03-27 12:11:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4c8de35b-ef90-5ef7-9bd4-77e49765b5df with scrape type 1
2026-03-27 12:11:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 4c8de35b-ef90-5ef7-9bd4-77e49765b5df
2026-03-27 12:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge5%252Ffc%252Fe5fc52aa7389b304f2b76a25a535637f%252Fpa%252FYE50957_9d241672af900714475e6ee23e2bd65d.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:11:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/fc/e5fc52aa7389b304f2b76a25a535637f/pa/YE50957_9d241672af900714475e6ee23e2bd65d.jpg already downloaded
2026-03-27 12:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge5%252Ffc%252Fe5fc52aa7389b304f2b76a25a535637f%252Fpa%252FYE50957_e879b6e0376323a57aa0738be7ece9ea.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:11:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/fc/e5fc52aa7389b304f2b76a25a535637f/pa/YE50957_e879b6e0376323a57aa0738be7ece9ea.jpg already downloaded
2026-03-27 12:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge5%252Ffc%252Fe5fc52aa7389b304f2b76a25a535637f%252Fpa%252FYE50957_29a2ce0fe5194a8126615950a6463e62.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:11:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/fc/e5fc52aa7389b304f2b76a25a535637f/pa/YE50957_29a2ce0fe5194a8126615950a6463e62.jpg already downloaded
2026-03-27 12:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge5%252Ffc%252Fe5fc52aa7389b304f2b76a25a535637f%252Fpa%252FYE50957_d8455d33ecc77dab2bfa57f2be0b772d.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:11:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/fc/e5fc52aa7389b304f2b76a25a535637f/pa/YE50957_d8455d33ecc77dab2bfa57f2be0b772d.jpg already downloaded
2026-03-27 12:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge5%252Ffc%252Fe5fc52aa7389b304f2b76a25a535637f%252Fpa%252FYE50957_11ca65726870b5f02d90aa2acbd52c88.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:11:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/fc/e5fc52aa7389b304f2b76a25a535637f/pa/YE50957_11ca65726870b5f02d90aa2acbd52c88.jpg already downloaded
2026-03-27 12:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge5%252Ffc%252Fe5fc52aa7389b304f2b76a25a535637f%252Fpa%252FYE50957_c0c7fa66adf72db2ecb8ff3919d12169.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:11:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/fc/e5fc52aa7389b304f2b76a25a535637f/pa/YE50957_c0c7fa66adf72db2ecb8ff3919d12169.jpg already downloaded
2026-03-27 12:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge5%252Ffc%252Fe5fc52aa7389b304f2b76a25a535637f%252Fpa%252FYE50957_9a880a688bba2d7d12e207d62f25fa4b.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:11:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/fc/e5fc52aa7389b304f2b76a25a535637f/pa/YE50957_9a880a688bba2d7d12e207d62f25fa4b.jpg already downloaded
2026-03-27 12:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge5%252Ffc%252Fe5fc52aa7389b304f2b76a25a535637f%252Fpa%252FYE50957_5144da4705d650a360a32bebf8c10db3.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:11:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/fc/e5fc52aa7389b304f2b76a25a535637f/pa/YE50957_5144da4705d650a360a32bebf8c10db3.jpg already downloaded
2026-03-27 12:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge5%252Ffc%252Fe5fc52aa7389b304f2b76a25a535637f%252Fpa%252FYE50957_d670407db5b261313b56e34d6b055686.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:11:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/fc/e5fc52aa7389b304f2b76a25a535637f/pa/YE50957_d670407db5b261313b56e34d6b055686.jpg already downloaded
2026-03-27 12:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimge5%252Ffc%252Fe5fc52aa7389b304f2b76a25a535637f%252Fpa%252FYE50957_5501beabee034d1de0f0f2d454d5f75c.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:11:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imge5/fc/e5fc52aa7389b304f2b76a25a535637f/pa/YE50957_5501beabee034d1de0f0f2d454d5f75c.jpg already downloaded
2026-03-27 12:11:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 4c8de35b-ef90-5ef7-9bd4-77e49765b5df, identifier: YE50957
2026-03-27 12:11:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 04fa97e3-66df-50cc-9db9-719167ae7290 with identifier: VR09113
2026-03-27 12:11:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 04fa97e3-66df-50cc-9db9-719167ae7290 with identifier: VR09113
2026-03-27 12:11:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 04fa97e3-66df-50cc-9db9-719167ae7290 with identifier: VR09113 to the API
2026-03-27 12:11:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 12:11:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 12:11:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/VR09113>
{'auction_title': '',
 'c_o_2_emission_value': 88,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'engine_horse_power': 70,
 'expiration_date': '2026-03-28T16:17:00Z',
 'fuel_type': 'petrol',
 'id': '04fa97e3-66df-50cc-9db9-719167ae7290',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'JH898B',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VR09113',
 'listing': 'auction',
 'location': 'NL, Oosterhout',
 'make': 'Toyota',
 'model': 'Aygo',
 'odometer': 75392,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img90/37/90377e89054aec82b78f8f0d7341bad6/pa/VR09113_39afb7c476779ddb94742adca934bb54.jpg',
                'https://img-pa.auto1.com/img90/37/90377e89054aec82b78f8f0d7341bad6/pa/VR09113_ee54419969b1511051fc1d91a3712c7c.jpg',
                'https://img-pa.auto1.com/img90/37/90377e89054aec82b78f8f0d7341bad6/pa/VR09113_3d36f3f5b63ffbab18435064cd052520.jpg',
                'https://img-pa.auto1.com/img90/37/90377e89054aec82b78f8f0d7341bad6/pa/VR09113_f50ee903b1298bedf3539abfacbe61bb.jpg',
                'https://img-pa.auto1.com/img90/37/90377e89054aec82b78f8f0d7341bad6/pa/VR09113_f70e484849a274a1bb36312aca754add.jpg',
                'https://img-pa.auto1.com/img90/37/90377e89054aec82b78f8f0d7341bad6/pa/VR09113_8557fbd98da350c76dd17bb2d5b6ed55.jpg',
                'https://img-pa.auto1.com/img90/37/90377e89054aec82b78f8f0d7341bad6/pa/VR09113_208dde48647eb5e9abd51dcf098e0f15.jpg',
                'https://img-pa.auto1.com/img90/37/90377e89054aec82b78f8f0d7341bad6/pa/VR09113_7a4aa62bc86378d5960c634ec6734fe9.jpg',
                'https://img-pa.auto1.com/img90/37/90377e89054aec82b78f8f0d7341bad6/pa/VR09113_ffbafbd657175b4519c2f81e8b4ca638.jpg',
                'https://img-pa.auto1.com/img90/37/90377e89054aec82b78f8f0d7341bad6/pa/VR09113_a9a12dbda419e806679a8609fe589dd8.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_04fa97e3-66df-50cc-9db9-719167ae7290/04fa97e3-66df-50cc-9db9-719167ae7290_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 99325,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img90/37/90377e89054aec82b78f8f0d7341bad6/pa/VR09113_39afb7c476779ddb94742adca934bb54.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_04fa97e3-66df-50cc-9db9-719167ae7290/04fa97e3-66df-50cc-9db9-719167ae7290_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 97998,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img90/37/90377e89054aec82b78f8f0d7341bad6/pa/VR09113_ee54419969b1511051fc1d91a3712c7c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_04fa97e3-66df-50cc-9db9-719167ae7290/04fa97e3-66df-50cc-9db9-719167ae7290_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83526,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img90/37/90377e89054aec82b78f8f0d7341bad6/pa/VR09113_3d36f3f5b63ffbab18435064cd052520.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_04fa97e3-66df-50cc-9db9-719167ae7290/04fa97e3-66df-50cc-9db9-719167ae7290_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67548,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img90/37/90377e89054aec82b78f8f0d7341bad6/pa/VR09113_f50ee903b1298bedf3539abfacbe61bb.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_04fa97e3-66df-50cc-9db9-719167ae7290/04fa97e3-66df-50cc-9db9-719167ae7290_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 96654,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img90/37/90377e89054aec82b78f8f0d7341bad6/pa/VR09113_f70e484849a274a1bb36312aca754add.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_04fa97e3-66df-50cc-9db9-719167ae7290/04fa97e3-66df-50cc-9db9-719167ae7290_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 90855,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img90/37/90377e89054aec82b78f8f0d7341bad6/pa/VR09113_8557fbd98da350c76dd17bb2d5b6ed55.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_04fa97e3-66df-50cc-9db9-719167ae7290/04fa97e3-66df-50cc-9db9-719167ae7290_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59938,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img90/37/90377e89054aec82b78f8f0d7341bad6/pa/VR09113_208dde48647eb5e9abd51dcf098e0f15.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_04fa97e3-66df-50cc-9db9-719167ae7290/04fa97e3-66df-50cc-9db9-719167ae7290_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 89768,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img90/37/90377e89054aec82b78f8f0d7341bad6/pa/VR09113_7a4aa62bc86378d5960c634ec6734fe9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_04fa97e3-66df-50cc-9db9-719167ae7290/04fa97e3-66df-50cc-9db9-719167ae7290_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79525,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img90/37/90377e89054aec82b78f8f0d7341bad6/pa/VR09113_ffbafbd657175b4519c2f81e8b4ca638.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_04fa97e3-66df-50cc-9db9-719167ae7290/04fa97e3-66df-50cc-9db9-719167ae7290_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72440,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img90/37/90377e89054aec82b78f8f0d7341bad6/pa/VR09113_a9a12dbda419e806679a8609fe589dd8.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2016-03-22',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Toyota Aygo 1.0 X',
 'transmission': 'manual',
 'trim': 'X',
 'year': 2016}
2026-03-27 12:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VR09113%27 HTTP/1.1" 200 None
2026-03-27 12:11:15 [auto1.nl] INFO: Saving data for VR09113: {'created_time': 1774613475.668072, 'last_price_update_time': 1774613475.668083, 'auction_closing_time': 1774714620.0}
2026-03-27 12:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='VR09113') HTTP/1.1" 204 0
2026-03-27 12:11:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 4c8de35b-ef90-5ef7-9bd4-77e49765b5df with identifier: YE50957
2026-03-27 12:11:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 4c8de35b-ef90-5ef7-9bd4-77e49765b5df with identifier: YE50957
2026-03-27 12:11:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 4c8de35b-ef90-5ef7-9bd4-77e49765b5df with identifier: YE50957 to the API
2026-03-27 12:11:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 12:11:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 12:11:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/YE50957>
{'auction_title': '',
 'c_o_2_emission_value': 121,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.3L',
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:22:41Z',
 'fuel_type': 'petrol',
 'id': '4c8de35b-ef90-5ef7-9bd4-77e49765b5df',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'J-159-JG',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YE50957',
 'listing': 'auction',
 'location': 'NL, Oosterhout',
 'make': 'Nissan',
 'model': 'Qashqai',
 'odometer': 136810,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/imge5/fc/e5fc52aa7389b304f2b76a25a535637f/pa/YE50957_9d241672af900714475e6ee23e2bd65d.jpg',
                'https://img-pa.auto1.com/imge5/fc/e5fc52aa7389b304f2b76a25a535637f/pa/YE50957_e879b6e0376323a57aa0738be7ece9ea.jpg',
                'https://img-pa.auto1.com/imge5/fc/e5fc52aa7389b304f2b76a25a535637f/pa/YE50957_29a2ce0fe5194a8126615950a6463e62.jpg',
                'https://img-pa.auto1.com/imge5/fc/e5fc52aa7389b304f2b76a25a535637f/pa/YE50957_d8455d33ecc77dab2bfa57f2be0b772d.jpg',
                'https://img-pa.auto1.com/imge5/fc/e5fc52aa7389b304f2b76a25a535637f/pa/YE50957_11ca65726870b5f02d90aa2acbd52c88.jpg',
                'https://img-pa.auto1.com/imge5/fc/e5fc52aa7389b304f2b76a25a535637f/pa/YE50957_c0c7fa66adf72db2ecb8ff3919d12169.jpg',
                'https://img-pa.auto1.com/imge5/fc/e5fc52aa7389b304f2b76a25a535637f/pa/YE50957_9a880a688bba2d7d12e207d62f25fa4b.jpg',
                'https://img-pa.auto1.com/imge5/fc/e5fc52aa7389b304f2b76a25a535637f/pa/YE50957_5144da4705d650a360a32bebf8c10db3.jpg',
                'https://img-pa.auto1.com/imge5/fc/e5fc52aa7389b304f2b76a25a535637f/pa/YE50957_d670407db5b261313b56e34d6b055686.jpg',
                'https://img-pa.auto1.com/imge5/fc/e5fc52aa7389b304f2b76a25a535637f/pa/YE50957_5501beabee034d1de0f0f2d454d5f75c.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c8de35b-ef90-5ef7-9bd4-77e49765b5df/4c8de35b-ef90-5ef7-9bd4-77e49765b5df_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 107834,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge5/fc/e5fc52aa7389b304f2b76a25a535637f/pa/YE50957_9d241672af900714475e6ee23e2bd65d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c8de35b-ef90-5ef7-9bd4-77e49765b5df/4c8de35b-ef90-5ef7-9bd4-77e49765b5df_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 110158,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge5/fc/e5fc52aa7389b304f2b76a25a535637f/pa/YE50957_e879b6e0376323a57aa0738be7ece9ea.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c8de35b-ef90-5ef7-9bd4-77e49765b5df/4c8de35b-ef90-5ef7-9bd4-77e49765b5df_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 99964,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge5/fc/e5fc52aa7389b304f2b76a25a535637f/pa/YE50957_29a2ce0fe5194a8126615950a6463e62.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c8de35b-ef90-5ef7-9bd4-77e49765b5df/4c8de35b-ef90-5ef7-9bd4-77e49765b5df_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72024,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge5/fc/e5fc52aa7389b304f2b76a25a535637f/pa/YE50957_d8455d33ecc77dab2bfa57f2be0b772d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c8de35b-ef90-5ef7-9bd4-77e49765b5df/4c8de35b-ef90-5ef7-9bd4-77e49765b5df_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 107681,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge5/fc/e5fc52aa7389b304f2b76a25a535637f/pa/YE50957_11ca65726870b5f02d90aa2acbd52c88.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c8de35b-ef90-5ef7-9bd4-77e49765b5df/4c8de35b-ef90-5ef7-9bd4-77e49765b5df_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 97684,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge5/fc/e5fc52aa7389b304f2b76a25a535637f/pa/YE50957_c0c7fa66adf72db2ecb8ff3919d12169.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c8de35b-ef90-5ef7-9bd4-77e49765b5df/4c8de35b-ef90-5ef7-9bd4-77e49765b5df_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62031,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge5/fc/e5fc52aa7389b304f2b76a25a535637f/pa/YE50957_9a880a688bba2d7d12e207d62f25fa4b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c8de35b-ef90-5ef7-9bd4-77e49765b5df/4c8de35b-ef90-5ef7-9bd4-77e49765b5df_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 95133,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge5/fc/e5fc52aa7389b304f2b76a25a535637f/pa/YE50957_5144da4705d650a360a32bebf8c10db3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c8de35b-ef90-5ef7-9bd4-77e49765b5df/4c8de35b-ef90-5ef7-9bd4-77e49765b5df_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 99977,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge5/fc/e5fc52aa7389b304f2b76a25a535637f/pa/YE50957_d670407db5b261313b56e34d6b055686.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c8de35b-ef90-5ef7-9bd4-77e49765b5df/4c8de35b-ef90-5ef7-9bd4-77e49765b5df_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65283,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imge5/fc/e5fc52aa7389b304f2b76a25a535637f/pa/YE50957_5501beabee034d1de0f0f2d454d5f75c.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-03-07',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Nissan Qashqai 1.3 DIG-T Visia',
 'transmission': 'manual',
 'trim': 'Visia',
 'year': 2019}
2026-03-27 12:11:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YE50957%27 HTTP/1.1" 200 None
2026-03-27 12:11:16 [auto1.nl] INFO: Saving data for YE50957: {'created_time': 1774613476.007134, 'last_price_update_time': 1774613476.007145, 'auction_closing_time': 1774714961.0}
2026-03-27 12:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='YE50957') HTTP/1.1" 204 0
2026-03-27 12:11:16 [auto1.nl] INFO: Channel: 24h | Page: 6 | totalHits: 1060 | hits on page: 40
2026-03-27 12:11:16 [auto1.nl] INFO: Found listing with ID: MK53801
2026-03-27 12:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MK53801%27 HTTP/1.1" 200 None
2026-03-27 12:11:16 [auto1.nl] INFO: Scrape type for MK53801: 0
2026-03-27 12:11:16 [auto1.nl] INFO: Found listing with ID: GD14705
2026-03-27 12:11:16 [auto1.nl] INFO: Found listing with ID: AZ90827
2026-03-27 12:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AZ90827%27 HTTP/1.1" 200 None
2026-03-27 12:11:16 [auto1.nl] INFO: Scrape type for AZ90827: 0
2026-03-27 12:11:16 [auto1.nl] INFO: Found listing with ID: SG30589
2026-03-27 12:11:16 [auto1.nl] INFO: Found listing with ID: FA26024
2026-03-27 12:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FA26024%27 HTTP/1.1" 200 None
2026-03-27 12:11:16 [auto1.nl] INFO: Scrape type for FA26024: 0
2026-03-27 12:11:16 [auto1.nl] INFO: Found listing with ID: ET91545
2026-03-27 12:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ET91545%27 HTTP/1.1" 200 None
2026-03-27 12:11:16 [auto1.nl] INFO: Scrape type for ET91545: 0
2026-03-27 12:11:16 [auto1.nl] INFO: Found listing with ID: XW85568
2026-03-27 12:11:16 [auto1.nl] INFO: Found listing with ID: PZ45874
2026-03-27 12:11:16 [auto1.nl] INFO: Found listing with ID: HB74565
2026-03-27 12:11:16 [auto1.nl] INFO: Found listing with ID: EW85240
2026-03-27 12:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EW85240%27 HTTP/1.1" 200 None
2026-03-27 12:11:16 [auto1.nl] INFO: Scrape type for EW85240: 0
2026-03-27 12:11:16 [auto1.nl] INFO: Found listing with ID: FD12318
2026-03-27 12:11:16 [auto1.nl] INFO: Found listing with ID: JK36770
2026-03-27 12:11:16 [auto1.nl] INFO: Found listing with ID: ZY88945
2026-03-27 12:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZY88945%27 HTTP/1.1" 200 None
2026-03-27 12:11:16 [auto1.nl] INFO: Scrape type for ZY88945: 0
2026-03-27 12:11:16 [auto1.nl] INFO: Found listing with ID: LT65669
2026-03-27 12:11:16 [auto1.nl] INFO: Found listing with ID: YD79188
2026-03-27 12:11:16 [auto1.nl] INFO: Found listing with ID: MX79285
2026-03-27 12:11:16 [auto1.nl] INFO: Found listing with ID: RG26073
2026-03-27 12:11:16 [auto1.nl] INFO: Found listing with ID: NY95005
2026-03-27 12:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NY95005%27 HTTP/1.1" 200 None
2026-03-27 12:11:16 [auto1.nl] INFO: Scrape type for NY95005: 0
2026-03-27 12:11:16 [auto1.nl] INFO: Found listing with ID: MP40330
2026-03-27 12:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MP40330%27 HTTP/1.1" 200 None
2026-03-27 12:11:16 [auto1.nl] INFO: Scrape type for MP40330: 0
2026-03-27 12:11:16 [auto1.nl] INFO: Found listing with ID: BB94394
2026-03-27 12:11:16 [auto1.nl] INFO: Found listing with ID: DX60140
2026-03-27 12:11:16 [auto1.nl] INFO: Found listing with ID: LC20908
2026-03-27 12:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LC20908%27 HTTP/1.1" 200 None
2026-03-27 12:11:16 [auto1.nl] INFO: Scrape type for LC20908: 0
2026-03-27 12:11:16 [auto1.nl] INFO: Found listing with ID: WG23592
2026-03-27 12:11:16 [auto1.nl] INFO: Found listing with ID: LT47952
2026-03-27 12:11:16 [auto1.nl] INFO: Found listing with ID: AG18358
2026-03-27 12:11:16 [auto1.nl] INFO: Found listing with ID: JG60699
2026-03-27 12:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JG60699%27 HTTP/1.1" 200 None
2026-03-27 12:11:16 [auto1.nl] INFO: Scrape type for JG60699: 0
2026-03-27 12:11:16 [auto1.nl] INFO: Found listing with ID: PW38124
2026-03-27 12:11:16 [auto1.nl] INFO: Found listing with ID: YT02782
2026-03-27 12:11:16 [auto1.nl] INFO: Found listing with ID: MM94423
2026-03-27 12:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MM94423%27 HTTP/1.1" 200 None
2026-03-27 12:11:16 [auto1.nl] INFO: Scrape type for MM94423: 0
2026-03-27 12:11:16 [auto1.nl] INFO: Found listing with ID: JK17445
2026-03-27 12:11:16 [auto1.nl] INFO: Found listing with ID: NX61669
2026-03-27 12:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NX61669%27 HTTP/1.1" 200 None
2026-03-27 12:11:16 [auto1.nl] INFO: Scrape type for NX61669: 0
2026-03-27 12:11:16 [auto1.nl] INFO: Found listing with ID: PZ31508
2026-03-27 12:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PZ31508%27 HTTP/1.1" 200 None
2026-03-27 12:11:16 [auto1.nl] INFO: Scrape type for PZ31508: 0
2026-03-27 12:11:16 [auto1.nl] INFO: Found listing with ID: EH82816
2026-03-27 12:11:16 [auto1.nl] INFO: Found listing with ID: GA05511
2026-03-27 12:11:16 [auto1.nl] INFO: Found listing with ID: CZ45443
2026-03-27 12:11:16 [auto1.nl] INFO: Found listing with ID: HF88100
2026-03-27 12:11:16 [auto1.nl] INFO: Found listing with ID: WH77322
2026-03-27 12:11:16 [auto1.nl] INFO: Found listing with ID: FB29349
2026-03-27 12:11:16 [auto1.nl] INFO: Found listing with ID: VV88142
2026-03-27 12:11:16 [auto1.nl] INFO: Found listing with ID: DB77408
2026-03-27 12:11:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BG27703/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 12:11:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 12:11:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/PK52304> (referer: https://www.auto1.com/v1/car-details-view/PK52304/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 12:11:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 12:11:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6fba4d92-838d-5542-9f04-425e067d37e7 with identifier: PK52304
2026-03-27 12:11:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6fba4d92-838d-5542-9f04-425e067d37e7 with scrape type 1
2026-03-27 12:11:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 6fba4d92-838d-5542-9f04-425e067d37e7
2026-03-27 12:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7f%252F3f%252F7f3f6a6965f0fbe977ca9173dedafbfc%252Fpa%252FPK52304_f88dc3ab19cf7358019d0925ab984132.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:11:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7f/3f/7f3f6a6965f0fbe977ca9173dedafbfc/pa/PK52304_f88dc3ab19cf7358019d0925ab984132.jpg not downloaded yet
2026-03-27 12:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7f%252F3f%252F7f3f6a6965f0fbe977ca9173dedafbfc%252Fpa%252FPK52304_20c9f2c79d11d3f3435e8b24fd64a128.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:11:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7f/3f/7f3f6a6965f0fbe977ca9173dedafbfc/pa/PK52304_20c9f2c79d11d3f3435e8b24fd64a128.jpg not downloaded yet
2026-03-27 12:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7f%252F3f%252F7f3f6a6965f0fbe977ca9173dedafbfc%252Fpa%252FPK52304_31e9c0a6f1d63d352f27961b161a31d6.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:11:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7f/3f/7f3f6a6965f0fbe977ca9173dedafbfc/pa/PK52304_31e9c0a6f1d63d352f27961b161a31d6.jpg not downloaded yet
2026-03-27 12:11:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/FP18275/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 12:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7f%252F3f%252F7f3f6a6965f0fbe977ca9173dedafbfc%252Fpa%252FPK52304_1ad6321d8d30061cfc03ff28e7c20cb4.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:11:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7f/3f/7f3f6a6965f0fbe977ca9173dedafbfc/pa/PK52304_1ad6321d8d30061cfc03ff28e7c20cb4.jpg not downloaded yet
2026-03-27 12:11:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 12:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg7f%252F3f%252F7f3f6a6965f0fbe977ca9173dedafbfc%252Fpa%252FPK52304_59d71a634ff2b88417c6e712138bdf1c.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:11:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7f/3f/7f3f6a6965f0fbe977ca9173dedafbfc/pa/PK52304_59d71a634ff2b88417c6e712138bdf1c.jpg not downloaded yet
2026-03-27 12:11:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EB00697/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 12:11:16 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 12:11:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7f/3f/7f3f6a6965f0fbe977ca9173dedafbfc/pa/PK52304_31e9c0a6f1d63d352f27961b161a31d6.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:11:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/MD45251/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 12:11:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 12:11:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/BV58634/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 12:11:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 12:11:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7f/3f/7f3f6a6965f0fbe977ca9173dedafbfc/pa/PK52304_59d71a634ff2b88417c6e712138bdf1c.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:11:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7f/3f/7f3f6a6965f0fbe977ca9173dedafbfc/pa/PK52304_20c9f2c79d11d3f3435e8b24fd64a128.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:11:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:11:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7d01a42650>
2026-03-27 12:11:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:11:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:11:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:11:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6fba4d92-838d-5542-9f04-425e067d37e7/6fba4d92-838d-5542-9f04-425e067d37e7_image_2.jpg HTTP/1.1" 201 0
2026-03-27 12:11:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7f%252F3f%252F7f3f6a6965f0fbe977ca9173dedafbfc%252Fpa%252FPK52304_31e9c0a6f1d63d352f27961b161a31d6.jpg') HTTP/1.1" 204 0
2026-03-27 12:11:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7f/3f/7f3f6a6965f0fbe977ca9173dedafbfc/pa/PK52304_31e9c0a6f1d63d352f27961b161a31d6.jpg saved to cache
2026-03-27 12:11:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 6fba4d92-838d-5542-9f04-425e067d37e7
2026-03-27 12:11:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7f/3f/7f3f6a6965f0fbe977ca9173dedafbfc/pa/PK52304_1ad6321d8d30061cfc03ff28e7c20cb4.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:11:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img7f/3f/7f3f6a6965f0fbe977ca9173dedafbfc/pa/PK52304_f88dc3ab19cf7358019d0925ab984132.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:11:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:11:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7cfccf8250>
2026-03-27 12:11:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:11:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:11:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:11:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6fba4d92-838d-5542-9f04-425e067d37e7/6fba4d92-838d-5542-9f04-425e067d37e7_image_4.jpg HTTP/1.1" 201 0
2026-03-27 12:11:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7f%252F3f%252F7f3f6a6965f0fbe977ca9173dedafbfc%252Fpa%252FPK52304_59d71a634ff2b88417c6e712138bdf1c.jpg') HTTP/1.1" 204 0
2026-03-27 12:11:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7f/3f/7f3f6a6965f0fbe977ca9173dedafbfc/pa/PK52304_59d71a634ff2b88417c6e712138bdf1c.jpg saved to cache
2026-03-27 12:11:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 6fba4d92-838d-5542-9f04-425e067d37e7
2026-03-27 12:11:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:11:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7cfe15b2d0>
2026-03-27 12:11:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:11:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:11:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:11:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6fba4d92-838d-5542-9f04-425e067d37e7/6fba4d92-838d-5542-9f04-425e067d37e7_image_1.jpg HTTP/1.1" 201 0
2026-03-27 12:11:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7f%252F3f%252F7f3f6a6965f0fbe977ca9173dedafbfc%252Fpa%252FPK52304_20c9f2c79d11d3f3435e8b24fd64a128.jpg') HTTP/1.1" 204 0
2026-03-27 12:11:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7f/3f/7f3f6a6965f0fbe977ca9173dedafbfc/pa/PK52304_20c9f2c79d11d3f3435e8b24fd64a128.jpg saved to cache
2026-03-27 12:11:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 6fba4d92-838d-5542-9f04-425e067d37e7
2026-03-27 12:11:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:11:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7cfdfaf1d0>
2026-03-27 12:11:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:11:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:11:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:11:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6fba4d92-838d-5542-9f04-425e067d37e7/6fba4d92-838d-5542-9f04-425e067d37e7_image_3.jpg HTTP/1.1" 201 0
2026-03-27 12:11:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7f%252F3f%252F7f3f6a6965f0fbe977ca9173dedafbfc%252Fpa%252FPK52304_1ad6321d8d30061cfc03ff28e7c20cb4.jpg') HTTP/1.1" 204 0
2026-03-27 12:11:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7f/3f/7f3f6a6965f0fbe977ca9173dedafbfc/pa/PK52304_1ad6321d8d30061cfc03ff28e7c20cb4.jpg saved to cache
2026-03-27 12:11:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 6fba4d92-838d-5542-9f04-425e067d37e7
2026-03-27 12:11:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:11:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7cfe11e810>
2026-03-27 12:11:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:11:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:11:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:11:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6fba4d92-838d-5542-9f04-425e067d37e7/6fba4d92-838d-5542-9f04-425e067d37e7_image_0.jpg HTTP/1.1" 201 0
2026-03-27 12:11:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg7f%252F3f%252F7f3f6a6965f0fbe977ca9173dedafbfc%252Fpa%252FPK52304_f88dc3ab19cf7358019d0925ab984132.jpg') HTTP/1.1" 204 0
2026-03-27 12:11:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img7f/3f/7f3f6a6965f0fbe977ca9173dedafbfc/pa/PK52304_f88dc3ab19cf7358019d0925ab984132.jpg saved to cache
2026-03-27 12:11:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6fba4d92-838d-5542-9f04-425e067d37e7
2026-03-27 12:11:17 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6fba4d92-838d-5542-9f04-425e067d37e7, skipping ID generation
2026-03-27 12:11:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6fba4d92-838d-5542-9f04-425e067d37e7 with scrape type 1
2026-03-27 12:11:17 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6fba4d92-838d-5542-9f04-425e067d37e7 sending to next pipeline
2026-03-27 12:11:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 6fba4d92-838d-5542-9f04-425e067d37e7, identifier: PK52304
2026-03-27 12:11:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 6fba4d92-838d-5542-9f04-425e067d37e7 with identifier: PK52304
2026-03-27 12:11:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 6fba4d92-838d-5542-9f04-425e067d37e7 with identifier: PK52304
2026-03-27 12:11:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 6fba4d92-838d-5542-9f04-425e067d37e7 with identifier: PK52304 to the API
2026-03-27 12:11:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 12:11:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 12:11:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img7f/3f/7f3f6a6965f0fbe977ca9173dedafbfc/pa/PK52304_f88dc3ab19cf7358019d0925ab984132.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '0.8L',
 'engine_horse_power': 52,
 'expiration_date': '2026-03-28T16:48:53Z',
 'fuel_type': 'petrol',
 'id': '6fba4d92-838d-5542-9f04-425e067d37e7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': '89SFHF',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PK52304',
 'listing': 'auction',
 'location': 'NL, Haarlem',
 'make': 'Chevrolet',
 'model': 'Matiz',
 'odometer': 156250,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6fba4d92-838d-5542-9f04-425e067d37e7/6fba4d92-838d-5542-9f04-425e067d37e7_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82445,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7f/3f/7f3f6a6965f0fbe977ca9173dedafbfc/pa/PK52304_f88dc3ab19cf7358019d0925ab984132.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6fba4d92-838d-5542-9f04-425e067d37e7/6fba4d92-838d-5542-9f04-425e067d37e7_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 70853,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7f/3f/7f3f6a6965f0fbe977ca9173dedafbfc/pa/PK52304_20c9f2c79d11d3f3435e8b24fd64a128.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6fba4d92-838d-5542-9f04-425e067d37e7/6fba4d92-838d-5542-9f04-425e067d37e7_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77285,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7f/3f/7f3f6a6965f0fbe977ca9173dedafbfc/pa/PK52304_31e9c0a6f1d63d352f27961b161a31d6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6fba4d92-838d-5542-9f04-425e067d37e7/6fba4d92-838d-5542-9f04-425e067d37e7_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68430,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7f/3f/7f3f6a6965f0fbe977ca9173dedafbfc/pa/PK52304_1ad6321d8d30061cfc03ff28e7c20cb4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6fba4d92-838d-5542-9f04-425e067d37e7/6fba4d92-838d-5542-9f04-425e067d37e7_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79087,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img7f/3f/7f3f6a6965f0fbe977ca9173dedafbfc/pa/PK52304_59d71a634ff2b88417c6e712138bdf1c.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2005-11-29',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Chevrolet Matiz 0.8 AT',
 'transmission': 'automatic',
 'trim': 'AT',
 'year': 2005}
2026-03-27 12:11:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PK52304%27 HTTP/1.1" 200 None
2026-03-27 12:11:17 [auto1.nl] INFO: Saving data for PK52304: {'created_time': 1774613477.847902, 'last_price_update_time': 1774613477.847911, 'auction_closing_time': 1774716533.0}
2026-03-27 12:11:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='PK52304') HTTP/1.1" 204 0
2026-03-27 12:11:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/EY85081/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 12:11:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/ES69537/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 12:11:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/SY10793/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 12:11:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 12:11:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 12:11:17 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 12:11:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FR68688> (referer: https://www.auto1.com/v1/car-details-view/FR68688/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 12:11:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 12:11:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SW07946> (referer: https://www.auto1.com/v1/car-details-view/SW07946/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 12:11:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 12:11:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 76a1108c-b5d7-57a0-89e5-34b437f0fb40 with identifier: FR68688
2026-03-27 12:11:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 76a1108c-b5d7-57a0-89e5-34b437f0fb40 with scrape type 1
2026-03-27 12:11:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 76a1108c-b5d7-57a0-89e5-34b437f0fb40
2026-03-27 12:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg88%252Fb9%252F88b92cdb4c8063993bcba71c3252525f%252Fpa%252FFR68688_345b87a1fb1aaaa2b27584bd925544a0.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:11:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img88/b9/88b92cdb4c8063993bcba71c3252525f/pa/FR68688_345b87a1fb1aaaa2b27584bd925544a0.jpg not downloaded yet
2026-03-27 12:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg88%252Fb9%252F88b92cdb4c8063993bcba71c3252525f%252Fpa%252FFR68688_cbfd8add973ff71b5c791446074e6c33.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:11:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img88/b9/88b92cdb4c8063993bcba71c3252525f/pa/FR68688_cbfd8add973ff71b5c791446074e6c33.jpg not downloaded yet
2026-03-27 12:11:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4d36e696-242f-50bd-b51a-cb662ac69482 with identifier: SW07946
2026-03-27 12:11:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4d36e696-242f-50bd-b51a-cb662ac69482 with scrape type 1
2026-03-27 12:11:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 4d36e696-242f-50bd-b51a-cb662ac69482
2026-03-27 12:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252Fb3%252Fdeb31bb4df775e323a3cf705e5b6ccbb%252Fpa%252FSW07946_591cfe6cf6af80939d614beee7deb219.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:11:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/b3/deb31bb4df775e323a3cf705e5b6ccbb/pa/SW07946_591cfe6cf6af80939d614beee7deb219.jpg not downloaded yet
2026-03-27 12:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg88%252Fb9%252F88b92cdb4c8063993bcba71c3252525f%252Fpa%252FFR68688_a2205b6789f68f012b4d5022f2b5e650.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:11:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img88/b9/88b92cdb4c8063993bcba71c3252525f/pa/FR68688_a2205b6789f68f012b4d5022f2b5e650.jpg not downloaded yet
2026-03-27 12:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252Fb3%252Fdeb31bb4df775e323a3cf705e5b6ccbb%252Fpa%252FSW07946_cb6830a1e118b198d7df457bd1c4b846.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:11:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/b3/deb31bb4df775e323a3cf705e5b6ccbb/pa/SW07946_cb6830a1e118b198d7df457bd1c4b846.jpg not downloaded yet
2026-03-27 12:11:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/GL61326/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 12:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg88%252Fb9%252F88b92cdb4c8063993bcba71c3252525f%252Fpa%252FFR68688_97dd5441d669215b6f0cc95d124a13d5.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:11:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img88/b9/88b92cdb4c8063993bcba71c3252525f/pa/FR68688_97dd5441d669215b6f0cc95d124a13d5.jpg not downloaded yet
2026-03-27 12:11:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 12:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252Fb3%252Fdeb31bb4df775e323a3cf705e5b6ccbb%252Fpa%252FSW07946_e4af824320963862fea2e99773b3643e.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:11:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/b3/deb31bb4df775e323a3cf705e5b6ccbb/pa/SW07946_e4af824320963862fea2e99773b3643e.jpg not downloaded yet
2026-03-27 12:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg88%252Fb9%252F88b92cdb4c8063993bcba71c3252525f%252Fpa%252FFR68688_51494f4f82e13a8930ca89de3757778a.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:11:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img88/b9/88b92cdb4c8063993bcba71c3252525f/pa/FR68688_51494f4f82e13a8930ca89de3757778a.jpg not downloaded yet
2026-03-27 12:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252Fb3%252Fdeb31bb4df775e323a3cf705e5b6ccbb%252Fpa%252FSW07946_e80b2677434e0de876c91ed8a36a80bd.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:11:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/b3/deb31bb4df775e323a3cf705e5b6ccbb/pa/SW07946_e80b2677434e0de876c91ed8a36a80bd.jpg not downloaded yet
2026-03-27 12:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252Fb3%252Fdeb31bb4df775e323a3cf705e5b6ccbb%252Fpa%252FSW07946_21a210b1f3768a277495829ab062742f.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:11:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/b3/deb31bb4df775e323a3cf705e5b6ccbb/pa/SW07946_21a210b1f3768a277495829ab062742f.jpg not downloaded yet
2026-03-27 12:11:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgde/b3/deb31bb4df775e323a3cf705e5b6ccbb/pa/SW07946_cb6830a1e118b198d7df457bd1c4b846.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:11:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:11:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7cfffda150>
2026-03-27 12:11:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:11:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:11:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:11:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4d36e696-242f-50bd-b51a-cb662ac69482/4d36e696-242f-50bd-b51a-cb662ac69482_image_1.jpg HTTP/1.1" 201 0
2026-03-27 12:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252Fb3%252Fdeb31bb4df775e323a3cf705e5b6ccbb%252Fpa%252FSW07946_cb6830a1e118b198d7df457bd1c4b846.jpg') HTTP/1.1" 204 0
2026-03-27 12:11:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/b3/deb31bb4df775e323a3cf705e5b6ccbb/pa/SW07946_cb6830a1e118b198d7df457bd1c4b846.jpg saved to cache
2026-03-27 12:11:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 4d36e696-242f-50bd-b51a-cb662ac69482
2026-03-27 12:11:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/WY03082/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 12:11:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 12:11:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/UF96545/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 12:11:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 12:11:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgde/b3/deb31bb4df775e323a3cf705e5b6ccbb/pa/SW07946_e80b2677434e0de876c91ed8a36a80bd.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:11:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgde/b3/deb31bb4df775e323a3cf705e5b6ccbb/pa/SW07946_21a210b1f3768a277495829ab062742f.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:11:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img88/b9/88b92cdb4c8063993bcba71c3252525f/pa/FR68688_51494f4f82e13a8930ca89de3757778a.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:11:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgde/b3/deb31bb4df775e323a3cf705e5b6ccbb/pa/SW07946_e4af824320963862fea2e99773b3643e.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:11:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:11:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7cfe13e210>
2026-03-27 12:11:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:11:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:11:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:11:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4d36e696-242f-50bd-b51a-cb662ac69482/4d36e696-242f-50bd-b51a-cb662ac69482_image_3.jpg HTTP/1.1" 201 0
2026-03-27 12:11:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252Fb3%252Fdeb31bb4df775e323a3cf705e5b6ccbb%252Fpa%252FSW07946_e80b2677434e0de876c91ed8a36a80bd.jpg') HTTP/1.1" 204 0
2026-03-27 12:11:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/b3/deb31bb4df775e323a3cf705e5b6ccbb/pa/SW07946_e80b2677434e0de876c91ed8a36a80bd.jpg saved to cache
2026-03-27 12:11:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 4d36e696-242f-50bd-b51a-cb662ac69482
2026-03-27 12:11:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:11:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7cfdeb58d0>
2026-03-27 12:11:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:11:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:11:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:11:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4d36e696-242f-50bd-b51a-cb662ac69482/4d36e696-242f-50bd-b51a-cb662ac69482_image_4.jpg HTTP/1.1" 201 0
2026-03-27 12:11:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252Fb3%252Fdeb31bb4df775e323a3cf705e5b6ccbb%252Fpa%252FSW07946_21a210b1f3768a277495829ab062742f.jpg') HTTP/1.1" 204 0
2026-03-27 12:11:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/b3/deb31bb4df775e323a3cf705e5b6ccbb/pa/SW07946_21a210b1f3768a277495829ab062742f.jpg saved to cache
2026-03-27 12:11:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 4d36e696-242f-50bd-b51a-cb662ac69482
2026-03-27 12:11:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:11:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7cfcc99050>
2026-03-27 12:11:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:11:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:11:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:11:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_76a1108c-b5d7-57a0-89e5-34b437f0fb40/76a1108c-b5d7-57a0-89e5-34b437f0fb40_image_4.jpg HTTP/1.1" 201 0
2026-03-27 12:11:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg88%252Fb9%252F88b92cdb4c8063993bcba71c3252525f%252Fpa%252FFR68688_51494f4f82e13a8930ca89de3757778a.jpg') HTTP/1.1" 204 0
2026-03-27 12:11:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img88/b9/88b92cdb4c8063993bcba71c3252525f/pa/FR68688_51494f4f82e13a8930ca89de3757778a.jpg saved to cache
2026-03-27 12:11:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 76a1108c-b5d7-57a0-89e5-34b437f0fb40
2026-03-27 12:11:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:11:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7cfce625d0>
2026-03-27 12:11:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:11:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:11:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:11:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4d36e696-242f-50bd-b51a-cb662ac69482/4d36e696-242f-50bd-b51a-cb662ac69482_image_2.jpg HTTP/1.1" 201 0
2026-03-27 12:11:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252Fb3%252Fdeb31bb4df775e323a3cf705e5b6ccbb%252Fpa%252FSW07946_e4af824320963862fea2e99773b3643e.jpg') HTTP/1.1" 204 0
2026-03-27 12:11:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/b3/deb31bb4df775e323a3cf705e5b6ccbb/pa/SW07946_e4af824320963862fea2e99773b3643e.jpg saved to cache
2026-03-27 12:11:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 4d36e696-242f-50bd-b51a-cb662ac69482
2026-03-27 12:11:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/FP18275> (referer: https://www.auto1.com/v1/car-details-view/FP18275/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 12:11:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BG27703> (referer: https://www.auto1.com/v1/car-details-view/BG27703/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 12:11:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 12:11:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 12:11:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 06c58ffe-f265-56ac-a40a-3ef24aa59319 with identifier: FP18275
2026-03-27 12:11:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 06c58ffe-f265-56ac-a40a-3ef24aa59319 with scrape type 1
2026-03-27 12:11:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 06c58ffe-f265-56ac-a40a-3ef24aa59319
2026-03-27 12:11:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg32%252F84%252F328439450be5ed07feb5f6037fed34e3%252Fpa%252FFP18275_6e873ee57fe11183cf2e0dcf40b0d024.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:11:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img32/84/328439450be5ed07feb5f6037fed34e3/pa/FP18275_6e873ee57fe11183cf2e0dcf40b0d024.jpg not downloaded yet
2026-03-27 12:11:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img88/b9/88b92cdb4c8063993bcba71c3252525f/pa/FR68688_a2205b6789f68f012b4d5022f2b5e650.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:11:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg32%252F84%252F328439450be5ed07feb5f6037fed34e3%252Fpa%252FFP18275_8c0cae720c93fe207ef616a0ed3d07f3.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:11:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img32/84/328439450be5ed07feb5f6037fed34e3/pa/FP18275_8c0cae720c93fe207ef616a0ed3d07f3.jpg not downloaded yet
2026-03-27 12:11:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: aa8b94a4-a373-5f9e-a5de-2e5c9e5565f9 with identifier: BG27703
2026-03-27 12:11:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item aa8b94a4-a373-5f9e-a5de-2e5c9e5565f9 with scrape type 1
2026-03-27 12:11:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item aa8b94a4-a373-5f9e-a5de-2e5c9e5565f9
2026-03-27 12:11:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252F80%252F65805ffbc2f187043f051c911130400b%252Fpa%252FBG27703_c881b58ac7fdb63cdf8153dcb9711c3b.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:11:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/80/65805ffbc2f187043f051c911130400b/pa/BG27703_c881b58ac7fdb63cdf8153dcb9711c3b.jpg not downloaded yet
2026-03-27 12:11:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg32%252F84%252F328439450be5ed07feb5f6037fed34e3%252Fpa%252FFP18275_e21f0567b8e3660faf939e110f1c1c39.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:11:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img32/84/328439450be5ed07feb5f6037fed34e3/pa/FP18275_e21f0567b8e3660faf939e110f1c1c39.jpg not downloaded yet
2026-03-27 12:11:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252F80%252F65805ffbc2f187043f051c911130400b%252Fpa%252FBG27703_5078dd48ccf77bacef6abec0883e4e19.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:11:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/80/65805ffbc2f187043f051c911130400b/pa/BG27703_5078dd48ccf77bacef6abec0883e4e19.jpg not downloaded yet
2026-03-27 12:11:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg32%252F84%252F328439450be5ed07feb5f6037fed34e3%252Fpa%252FFP18275_a313a978df61076d6691aad5f9d10cac.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:11:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img32/84/328439450be5ed07feb5f6037fed34e3/pa/FP18275_a313a978df61076d6691aad5f9d10cac.jpg not downloaded yet
2026-03-27 12:11:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252F80%252F65805ffbc2f187043f051c911130400b%252Fpa%252FBG27703_6e735c0b82e259746020c82b8940b660.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:11:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/80/65805ffbc2f187043f051c911130400b/pa/BG27703_6e735c0b82e259746020c82b8940b660.jpg not downloaded yet
2026-03-27 12:11:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img88/b9/88b92cdb4c8063993bcba71c3252525f/pa/FR68688_97dd5441d669215b6f0cc95d124a13d5.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:11:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg32%252F84%252F328439450be5ed07feb5f6037fed34e3%252Fpa%252FFP18275_b766fea727b974c80ab5910e2fd35462.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:11:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img32/84/328439450be5ed07feb5f6037fed34e3/pa/FP18275_b766fea727b974c80ab5910e2fd35462.jpg not downloaded yet
2026-03-27 12:11:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img32/84/328439450be5ed07feb5f6037fed34e3/pa/FP18275_6e873ee57fe11183cf2e0dcf40b0d024.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:11:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252F80%252F65805ffbc2f187043f051c911130400b%252Fpa%252FBG27703_8b8bca5f4c8e00d0af1f787a703af872.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:11:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/80/65805ffbc2f187043f051c911130400b/pa/BG27703_8b8bca5f4c8e00d0af1f787a703af872.jpg not downloaded yet
2026-03-27 12:11:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EB00697> (referer: https://www.auto1.com/v1/car-details-view/EB00697/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 12:11:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg32%252F84%252F328439450be5ed07feb5f6037fed34e3%252Fpa%252FFP18275_9e2ac84aeb4ad7f35003c21173b81af6.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:11:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img32/84/328439450be5ed07feb5f6037fed34e3/pa/FP18275_9e2ac84aeb4ad7f35003c21173b81af6.jpg not downloaded yet
2026-03-27 12:11:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 12:11:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:11:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7cfe13ef10>
2026-03-27 12:11:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:11:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:11:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:11:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_76a1108c-b5d7-57a0-89e5-34b437f0fb40/76a1108c-b5d7-57a0-89e5-34b437f0fb40_image_2.jpg HTTP/1.1" 201 0
2026-03-27 12:11:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg88%252Fb9%252F88b92cdb4c8063993bcba71c3252525f%252Fpa%252FFR68688_a2205b6789f68f012b4d5022f2b5e650.jpg') HTTP/1.1" 204 0
2026-03-27 12:11:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img88/b9/88b92cdb4c8063993bcba71c3252525f/pa/FR68688_a2205b6789f68f012b4d5022f2b5e650.jpg saved to cache
2026-03-27 12:11:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 76a1108c-b5d7-57a0-89e5-34b437f0fb40
2026-03-27 12:11:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252F80%252F65805ffbc2f187043f051c911130400b%252Fpa%252FBG27703_5c2d652a5dd6d11e09e728ccbc1cace1.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:11:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/80/65805ffbc2f187043f051c911130400b/pa/BG27703_5c2d652a5dd6d11e09e728ccbc1cace1.jpg not downloaded yet
2026-03-27 12:11:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg32%252F84%252F328439450be5ed07feb5f6037fed34e3%252Fpa%252FFP18275_8328901bcddcefe81dbfe57a52b06b1e.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:11:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img32/84/328439450be5ed07feb5f6037fed34e3/pa/FP18275_8328901bcddcefe81dbfe57a52b06b1e.jpg not downloaded yet
2026-03-27 12:11:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BM13348> (referer: https://www.auto1.com/v1/car-details-view/BM13348/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 12:11:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252F80%252F65805ffbc2f187043f051c911130400b%252Fpa%252FBG27703_141359cf0934d4dc9763c142a660674c.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:11:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/80/65805ffbc2f187043f051c911130400b/pa/BG27703_141359cf0934d4dc9763c142a660674c.jpg not downloaded yet
2026-03-27 12:11:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 12:11:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:11:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7cfdfa8850>
2026-03-27 12:11:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:11:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:11:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:11:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_76a1108c-b5d7-57a0-89e5-34b437f0fb40/76a1108c-b5d7-57a0-89e5-34b437f0fb40_image_3.jpg HTTP/1.1" 201 0
2026-03-27 12:11:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg88%252Fb9%252F88b92cdb4c8063993bcba71c3252525f%252Fpa%252FFR68688_97dd5441d669215b6f0cc95d124a13d5.jpg') HTTP/1.1" 204 0
2026-03-27 12:11:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img88/b9/88b92cdb4c8063993bcba71c3252525f/pa/FR68688_97dd5441d669215b6f0cc95d124a13d5.jpg saved to cache
2026-03-27 12:11:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 76a1108c-b5d7-57a0-89e5-34b437f0fb40
2026-03-27 12:11:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg32%252F84%252F328439450be5ed07feb5f6037fed34e3%252Fpa%252FFP18275_02b4429b1af9b7d784cab7a51920407e.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:11:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img32/84/328439450be5ed07feb5f6037fed34e3/pa/FP18275_02b4429b1af9b7d784cab7a51920407e.jpg not downloaded yet
2026-03-27 12:11:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252F80%252F65805ffbc2f187043f051c911130400b%252Fpa%252FBG27703_80b2654f17b38553d53e3306f553a473.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:11:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/80/65805ffbc2f187043f051c911130400b/pa/BG27703_80b2654f17b38553d53e3306f553a473.jpg not downloaded yet
2026-03-27 12:11:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg32%252F84%252F328439450be5ed07feb5f6037fed34e3%252Fpa%252FFP18275_ecf3a8063dd8bca62ba972a1685da910.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:11:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img32/84/328439450be5ed07feb5f6037fed34e3/pa/FP18275_ecf3a8063dd8bca62ba972a1685da910.jpg not downloaded yet
2026-03-27 12:11:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:11:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7cfdfd51d0>
2026-03-27 12:11:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:11:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:11:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:11:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_06c58ffe-f265-56ac-a40a-3ef24aa59319/06c58ffe-f265-56ac-a40a-3ef24aa59319_image_0.jpg HTTP/1.1" 201 0
2026-03-27 12:11:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg32%252F84%252F328439450be5ed07feb5f6037fed34e3%252Fpa%252FFP18275_6e873ee57fe11183cf2e0dcf40b0d024.jpg') HTTP/1.1" 204 0
2026-03-27 12:11:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img32/84/328439450be5ed07feb5f6037fed34e3/pa/FP18275_6e873ee57fe11183cf2e0dcf40b0d024.jpg saved to cache
2026-03-27 12:11:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 06c58ffe-f265-56ac-a40a-3ef24aa59319
2026-03-27 12:11:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b5b36c08-995b-57ef-acbe-81463121f442 with identifier: EB00697
2026-03-27 12:11:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b5b36c08-995b-57ef-acbe-81463121f442 with scrape type 1
2026-03-27 12:11:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b5b36c08-995b-57ef-acbe-81463121f442
2026-03-27 12:11:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252F43%252F6c432be0d6abf3032db6f619323090a4%252Fpa%252FEB00697_225235b8eb1c3844d05832705e62ac40.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:11:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/43/6c432be0d6abf3032db6f619323090a4/pa/EB00697_225235b8eb1c3844d05832705e62ac40.jpg already downloaded
2026-03-27 12:11:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252F43%252F6c432be0d6abf3032db6f619323090a4%252Fpa%252FEB00697_13e1a854e62de95efdf716a77057aeb3.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:11:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/43/6c432be0d6abf3032db6f619323090a4/pa/EB00697_13e1a854e62de95efdf716a77057aeb3.jpg already downloaded
2026-03-27 12:11:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252F43%252F6c432be0d6abf3032db6f619323090a4%252Fpa%252FEB00697_0bd1cdc49341a624e909c02c3ba193f6.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:11:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/43/6c432be0d6abf3032db6f619323090a4/pa/EB00697_0bd1cdc49341a624e909c02c3ba193f6.jpg already downloaded
2026-03-27 12:11:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252F43%252F6c432be0d6abf3032db6f619323090a4%252Fpa%252FEB00697_84845bb0951d581f63cb532e80ab21be.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:11:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/43/6c432be0d6abf3032db6f619323090a4/pa/EB00697_84845bb0951d581f63cb532e80ab21be.jpg already downloaded
2026-03-27 12:11:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252F43%252F6c432be0d6abf3032db6f619323090a4%252Fpa%252FEB00697_3d61d96ba49e18406002c3d0fbc86bb4.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:11:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/43/6c432be0d6abf3032db6f619323090a4/pa/EB00697_3d61d96ba49e18406002c3d0fbc86bb4.jpg already downloaded
2026-03-27 12:11:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252F43%252F6c432be0d6abf3032db6f619323090a4%252Fpa%252FEB00697_018350640f931a29fe6ae347fa64e1d7.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:11:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/43/6c432be0d6abf3032db6f619323090a4/pa/EB00697_018350640f931a29fe6ae347fa64e1d7.jpg already downloaded
2026-03-27 12:11:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252F43%252F6c432be0d6abf3032db6f619323090a4%252Fpa%252FEB00697_4cc72dab5002ac9170233c4b839cbf51.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:11:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/43/6c432be0d6abf3032db6f619323090a4/pa/EB00697_4cc72dab5002ac9170233c4b839cbf51.jpg already downloaded
2026-03-27 12:11:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252F43%252F6c432be0d6abf3032db6f619323090a4%252Fpa%252FEB00697_65fc689b367fd6611024b8eab6e1fbe7.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:11:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/43/6c432be0d6abf3032db6f619323090a4/pa/EB00697_65fc689b367fd6611024b8eab6e1fbe7.jpg already downloaded
2026-03-27 12:11:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252F43%252F6c432be0d6abf3032db6f619323090a4%252Fpa%252FEB00697_2a2cc8cbc3a17c7afdff9fee89489fa7.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:11:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/43/6c432be0d6abf3032db6f619323090a4/pa/EB00697_2a2cc8cbc3a17c7afdff9fee89489fa7.jpg already downloaded
2026-03-27 12:11:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg6c%252F43%252F6c432be0d6abf3032db6f619323090a4%252Fpa%252FEB00697_fb0f314060babef440abb9e055b8063c.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:11:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img6c/43/6c432be0d6abf3032db6f619323090a4/pa/EB00697_fb0f314060babef440abb9e055b8063c.jpg already downloaded
2026-03-27 12:11:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: b5b36c08-995b-57ef-acbe-81463121f442, identifier: EB00697
2026-03-27 12:11:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252F80%252F65805ffbc2f187043f051c911130400b%252Fpa%252FBG27703_70aae8a624b76578606924aa6397aecd.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:11:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/80/65805ffbc2f187043f051c911130400b/pa/BG27703_70aae8a624b76578606924aa6397aecd.jpg not downloaded yet
2026-03-27 12:11:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: b5b36c08-995b-57ef-acbe-81463121f442 with identifier: EB00697
2026-03-27 12:11:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: b5b36c08-995b-57ef-acbe-81463121f442 with identifier: EB00697
2026-03-27 12:11:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: b5b36c08-995b-57ef-acbe-81463121f442 with identifier: EB00697 to the API
2026-03-27 12:11:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 12:11:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 12:11:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/EB00697>
{'auction_title': '',
 'c_o_2_emission_value': 256,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '4.8L',
 'engine_horse_power': 430,
 'expiration_date': '2026-03-28T16:07:55Z',
 'fuel_type': 'petrol',
 'id': 'b5b36c08-995b-57ef-acbe-81463121f442',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': '9ZSF54',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EB00697',
 'listing': 'auction',
 'location': 'NL, Oosterhout',
 'make': 'Porsche',
 'model': 'Panamera',
 'odometer': 122496,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img6c/43/6c432be0d6abf3032db6f619323090a4/pa/EB00697_225235b8eb1c3844d05832705e62ac40.jpg',
                'https://img-pa.auto1.com/img6c/43/6c432be0d6abf3032db6f619323090a4/pa/EB00697_13e1a854e62de95efdf716a77057aeb3.jpg',
                'https://img-pa.auto1.com/img6c/43/6c432be0d6abf3032db6f619323090a4/pa/EB00697_0bd1cdc49341a624e909c02c3ba193f6.jpg',
                'https://img-pa.auto1.com/img6c/43/6c432be0d6abf3032db6f619323090a4/pa/EB00697_84845bb0951d581f63cb532e80ab21be.jpg',
                'https://img-pa.auto1.com/img6c/43/6c432be0d6abf3032db6f619323090a4/pa/EB00697_3d61d96ba49e18406002c3d0fbc86bb4.jpg',
                'https://img-pa.auto1.com/img6c/43/6c432be0d6abf3032db6f619323090a4/pa/EB00697_018350640f931a29fe6ae347fa64e1d7.jpg',
                'https://img-pa.auto1.com/img6c/43/6c432be0d6abf3032db6f619323090a4/pa/EB00697_4cc72dab5002ac9170233c4b839cbf51.jpg',
                'https://img-pa.auto1.com/img6c/43/6c432be0d6abf3032db6f619323090a4/pa/EB00697_65fc689b367fd6611024b8eab6e1fbe7.jpg',
                'https://img-pa.auto1.com/img6c/43/6c432be0d6abf3032db6f619323090a4/pa/EB00697_2a2cc8cbc3a17c7afdff9fee89489fa7.jpg',
                'https://img-pa.auto1.com/img6c/43/6c432be0d6abf3032db6f619323090a4/pa/EB00697_fb0f314060babef440abb9e055b8063c.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b5b36c08-995b-57ef-acbe-81463121f442/b5b36c08-995b-57ef-acbe-81463121f442_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59339,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6c/43/6c432be0d6abf3032db6f619323090a4/pa/EB00697_225235b8eb1c3844d05832705e62ac40.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b5b36c08-995b-57ef-acbe-81463121f442/b5b36c08-995b-57ef-acbe-81463121f442_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57937,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6c/43/6c432be0d6abf3032db6f619323090a4/pa/EB00697_13e1a854e62de95efdf716a77057aeb3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b5b36c08-995b-57ef-acbe-81463121f442/b5b36c08-995b-57ef-acbe-81463121f442_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60581,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6c/43/6c432be0d6abf3032db6f619323090a4/pa/EB00697_0bd1cdc49341a624e909c02c3ba193f6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b5b36c08-995b-57ef-acbe-81463121f442/b5b36c08-995b-57ef-acbe-81463121f442_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57184,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6c/43/6c432be0d6abf3032db6f619323090a4/pa/EB00697_84845bb0951d581f63cb532e80ab21be.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b5b36c08-995b-57ef-acbe-81463121f442/b5b36c08-995b-57ef-acbe-81463121f442_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 48167,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6c/43/6c432be0d6abf3032db6f619323090a4/pa/EB00697_3d61d96ba49e18406002c3d0fbc86bb4.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b5b36c08-995b-57ef-acbe-81463121f442/b5b36c08-995b-57ef-acbe-81463121f442_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 42123,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6c/43/6c432be0d6abf3032db6f619323090a4/pa/EB00697_018350640f931a29fe6ae347fa64e1d7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b5b36c08-995b-57ef-acbe-81463121f442/b5b36c08-995b-57ef-acbe-81463121f442_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 33312,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6c/43/6c432be0d6abf3032db6f619323090a4/pa/EB00697_4cc72dab5002ac9170233c4b839cbf51.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b5b36c08-995b-57ef-acbe-81463121f442/b5b36c08-995b-57ef-acbe-81463121f442_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51587,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6c/43/6c432be0d6abf3032db6f619323090a4/pa/EB00697_65fc689b367fd6611024b8eab6e1fbe7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b5b36c08-995b-57ef-acbe-81463121f442/b5b36c08-995b-57ef-acbe-81463121f442_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56640,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6c/43/6c432be0d6abf3032db6f619323090a4/pa/EB00697_2a2cc8cbc3a17c7afdff9fee89489fa7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b5b36c08-995b-57ef-acbe-81463121f442/b5b36c08-995b-57ef-acbe-81463121f442_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 42656,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img6c/43/6c432be0d6abf3032db6f619323090a4/pa/EB00697_fb0f314060babef440abb9e055b8063c.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2012-12-02',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Porsche Panamera GTS',
 'transmission': 'automatic',
 'trim': '',
 'year': 2012}
2026-03-27 12:11:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EB00697%27 HTTP/1.1" 200 None
2026-03-27 12:11:20 [auto1.nl] INFO: Saving data for EB00697: {'created_time': 1774613480.339282, 'last_price_update_time': 1774613480.339293, 'auction_closing_time': 1774714075.0}
2026-03-27 12:11:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='EB00697') HTTP/1.1" 204 0
2026-03-27 12:11:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img32/84/328439450be5ed07feb5f6037fed34e3/pa/FP18275_a313a978df61076d6691aad5f9d10cac.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:11:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg32%252F84%252F328439450be5ed07feb5f6037fed34e3%252Fpa%252FFP18275_575a707a38801dac5ff29dfb9925223c.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:11:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img32/84/328439450be5ed07feb5f6037fed34e3/pa/FP18275_575a707a38801dac5ff29dfb9925223c.jpg not downloaded yet
2026-03-27 12:11:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252F80%252F65805ffbc2f187043f051c911130400b%252Fpa%252FBG27703_b23872d03e5bc583630f59759a944ec6.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:11:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/80/65805ffbc2f187043f051c911130400b/pa/BG27703_b23872d03e5bc583630f59759a944ec6.jpg not downloaded yet
2026-03-27 12:11:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GN29290> (referer: https://www.auto1.com/v1/car-details-view/GN29290/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 12:11:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6e57e3dd-efcf-52e5-8a14-6ed566443adc with identifier: BM13348
2026-03-27 12:11:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6e57e3dd-efcf-52e5-8a14-6ed566443adc with scrape type 1
2026-03-27 12:11:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 6e57e3dd-efcf-52e5-8a14-6ed566443adc
2026-03-27 12:11:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg06%252Fd2%252F06d2dd16642358e8b7088b828e0fb47d%252Fpa%252FBM13348_98574d23e9a1b261c0781eeef5fabf7c.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:11:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/d2/06d2dd16642358e8b7088b828e0fb47d/pa/BM13348_98574d23e9a1b261c0781eeef5fabf7c.jpg not downloaded yet
2026-03-27 12:11:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 12:11:20 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 12:11:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/MD45251> (referer: https://www.auto1.com/v1/car-details-view/MD45251/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 12:11:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252F80%252F65805ffbc2f187043f051c911130400b%252Fpa%252FBG27703_fbe0035e0bbde9820bea1b830d915aca.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:11:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/80/65805ffbc2f187043f051c911130400b/pa/BG27703_fbe0035e0bbde9820bea1b830d915aca.jpg not downloaded yet
2026-03-27 12:11:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 12:11:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 12:11:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg06%252Fd2%252F06d2dd16642358e8b7088b828e0fb47d%252Fpa%252FBM13348_91c240ee7f2603ca67c8191c2eaba0fd.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:11:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/d2/06d2dd16642358e8b7088b828e0fb47d/pa/BM13348_91c240ee7f2603ca67c8191c2eaba0fd.jpg not downloaded yet
2026-03-27 12:11:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg06%252Fd2%252F06d2dd16642358e8b7088b828e0fb47d%252Fpa%252FBM13348_42be10a9145da5c016d53a93e95965c3.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:11:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/d2/06d2dd16642358e8b7088b828e0fb47d/pa/BM13348_42be10a9145da5c016d53a93e95965c3.jpg not downloaded yet
2026-03-27 12:11:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg06%252Fd2%252F06d2dd16642358e8b7088b828e0fb47d%252Fpa%252FBM13348_f3ceb46d4cb559026a144362c79dafe2.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:11:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/d2/06d2dd16642358e8b7088b828e0fb47d/pa/BM13348_f3ceb46d4cb559026a144362c79dafe2.jpg not downloaded yet
2026-03-27 12:11:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:11:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7cfdfd1e90>
2026-03-27 12:11:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:11:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:11:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:11:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_06c58ffe-f265-56ac-a40a-3ef24aa59319/06c58ffe-f265-56ac-a40a-3ef24aa59319_image_3.jpg HTTP/1.1" 201 0
2026-03-27 12:11:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg32%252F84%252F328439450be5ed07feb5f6037fed34e3%252Fpa%252FFP18275_a313a978df61076d6691aad5f9d10cac.jpg') HTTP/1.1" 204 0
2026-03-27 12:11:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img32/84/328439450be5ed07feb5f6037fed34e3/pa/FP18275_a313a978df61076d6691aad5f9d10cac.jpg saved to cache
2026-03-27 12:11:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 06c58ffe-f265-56ac-a40a-3ef24aa59319
2026-03-27 12:11:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg06%252Fd2%252F06d2dd16642358e8b7088b828e0fb47d%252Fpa%252FBM13348_3c36f0c1f1488b18f27f21bcf69cf82c.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:11:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/d2/06d2dd16642358e8b7088b828e0fb47d/pa/BM13348_3c36f0c1f1488b18f27f21bcf69cf82c.jpg not downloaded yet
2026-03-27 12:11:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img06/d2/06d2dd16642358e8b7088b828e0fb47d/pa/BM13348_98574d23e9a1b261c0781eeef5fabf7c.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:11:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img65/80/65805ffbc2f187043f051c911130400b/pa/BG27703_b23872d03e5bc583630f59759a944ec6.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:11:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg06%252Fd2%252F06d2dd16642358e8b7088b828e0fb47d%252Fpa%252FBM13348_789876ffcb50e420b884bdd220361aa9.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:11:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/d2/06d2dd16642358e8b7088b828e0fb47d/pa/BM13348_789876ffcb50e420b884bdd220361aa9.jpg not downloaded yet
2026-03-27 12:11:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 20d870f5-f553-571d-9e90-79e301fa3cd6 with identifier: GN29290
2026-03-27 12:11:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 20d870f5-f553-571d-9e90-79e301fa3cd6 with scrape type 1
2026-03-27 12:11:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 20d870f5-f553-571d-9e90-79e301fa3cd6
2026-03-27 12:11:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252F38%252Fb238383c8c2b639c5913aed2f0969c5c%252Fpa%252FGN29290_c70fa92c17dac1a4e54ce0167d67e2ef.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:11:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/38/b238383c8c2b639c5913aed2f0969c5c/pa/GN29290_c70fa92c17dac1a4e54ce0167d67e2ef.jpg already downloaded
2026-03-27 12:11:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252F38%252Fb238383c8c2b639c5913aed2f0969c5c%252Fpa%252FGN29290_ebb374e98721c43d0a57f687eeb1269e.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:11:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/38/b238383c8c2b639c5913aed2f0969c5c/pa/GN29290_ebb374e98721c43d0a57f687eeb1269e.jpg already downloaded
2026-03-27 12:11:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252F38%252Fb238383c8c2b639c5913aed2f0969c5c%252Fpa%252FGN29290_9298ed33a69a36e3bd5a7a94e7180f93.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:11:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/38/b238383c8c2b639c5913aed2f0969c5c/pa/GN29290_9298ed33a69a36e3bd5a7a94e7180f93.jpg already downloaded
2026-03-27 12:11:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252F38%252Fb238383c8c2b639c5913aed2f0969c5c%252Fpa%252FGN29290_acfa3edb164e24d7f286e6d60dacaf0f.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:11:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/38/b238383c8c2b639c5913aed2f0969c5c/pa/GN29290_acfa3edb164e24d7f286e6d60dacaf0f.jpg already downloaded
2026-03-27 12:11:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgb2%252F38%252Fb238383c8c2b639c5913aed2f0969c5c%252Fpa%252FGN29290_5c5069f664044d22333005874de1a8a6.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:11:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgb2/38/b238383c8c2b639c5913aed2f0969c5c/pa/GN29290_5c5069f664044d22333005874de1a8a6.jpg already downloaded
2026-03-27 12:11:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 20d870f5-f553-571d-9e90-79e301fa3cd6, identifier: GN29290
2026-03-27 12:11:20 [auto1.nl] INFO: Channel: 24h | Page: 7 | totalHits: 1060 | hits on page: 40
2026-03-27 12:11:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 666aa210-f426-54cd-a1d4-3adb8819bfed with identifier: MD45251
2026-03-27 12:11:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 666aa210-f426-54cd-a1d4-3adb8819bfed with scrape type 1
2026-03-27 12:11:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 666aa210-f426-54cd-a1d4-3adb8819bfed
2026-03-27 12:11:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg41%252F58%252F4158e35b51c530a5e50603fa3ff1822a%252Fpa%252FMD45251_4bb3c9af338cd71eb06c85b7488a6099.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:11:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img41/58/4158e35b51c530a5e50603fa3ff1822a/pa/MD45251_4bb3c9af338cd71eb06c85b7488a6099.jpg not downloaded yet
2026-03-27 12:11:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 20d870f5-f553-571d-9e90-79e301fa3cd6 with identifier: GN29290
2026-03-27 12:11:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 20d870f5-f553-571d-9e90-79e301fa3cd6 with identifier: GN29290
2026-03-27 12:11:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 20d870f5-f553-571d-9e90-79e301fa3cd6 with identifier: GN29290 to the API
2026-03-27 12:11:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 12:11:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 12:11:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/GN29290>
{'auction_title': '',
 'c_o_2_emission_value': 159,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '1.6L',
 'engine_horse_power': 120,
 'expiration_date': '2026-03-28T16:59:20Z',
 'fuel_type': 'petrol',
 'id': '20d870f5-f553-571d-9e90-79e301fa3cd6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': '92XRZS',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GN29290',
 'listing': 'auction',
 'location': 'NL, Oosterhout',
 'make': 'Peugeot',
 'model': '308',
 'odometer': 151554,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 5,
 'photo_urls': ['https://img-pa.auto1.com/imgb2/38/b238383c8c2b639c5913aed2f0969c5c/pa/GN29290_c70fa92c17dac1a4e54ce0167d67e2ef.jpg',
                'https://img-pa.auto1.com/imgb2/38/b238383c8c2b639c5913aed2f0969c5c/pa/GN29290_ebb374e98721c43d0a57f687eeb1269e.jpg',
                'https://img-pa.auto1.com/imgb2/38/b238383c8c2b639c5913aed2f0969c5c/pa/GN29290_9298ed33a69a36e3bd5a7a94e7180f93.jpg',
                'https://img-pa.auto1.com/imgb2/38/b238383c8c2b639c5913aed2f0969c5c/pa/GN29290_acfa3edb164e24d7f286e6d60dacaf0f.jpg',
                'https://img-pa.auto1.com/imgb2/38/b238383c8c2b639c5913aed2f0969c5c/pa/GN29290_5c5069f664044d22333005874de1a8a6.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_20d870f5-f553-571d-9e90-79e301fa3cd6/20d870f5-f553-571d-9e90-79e301fa3cd6_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83963,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb2/38/b238383c8c2b639c5913aed2f0969c5c/pa/GN29290_c70fa92c17dac1a4e54ce0167d67e2ef.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_20d870f5-f553-571d-9e90-79e301fa3cd6/20d870f5-f553-571d-9e90-79e301fa3cd6_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81206,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb2/38/b238383c8c2b639c5913aed2f0969c5c/pa/GN29290_ebb374e98721c43d0a57f687eeb1269e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_20d870f5-f553-571d-9e90-79e301fa3cd6/20d870f5-f553-571d-9e90-79e301fa3cd6_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67145,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb2/38/b238383c8c2b639c5913aed2f0969c5c/pa/GN29290_9298ed33a69a36e3bd5a7a94e7180f93.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_20d870f5-f553-571d-9e90-79e301fa3cd6/20d870f5-f553-571d-9e90-79e301fa3cd6_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79976,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb2/38/b238383c8c2b639c5913aed2f0969c5c/pa/GN29290_acfa3edb164e24d7f286e6d60dacaf0f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_20d870f5-f553-571d-9e90-79e301fa3cd6/20d870f5-f553-571d-9e90-79e301fa3cd6_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 101519,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgb2/38/b238383c8c2b639c5913aed2f0969c5c/pa/GN29290_5c5069f664044d22333005874de1a8a6.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2007-09-13',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Peugeot 308 1.6 Platinum',
 'transmission': 'manual',
 'trim': 'Platinum',
 'year': 2007}
2026-03-27 12:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GN29290%27 HTTP/1.1" 200 None
2026-03-27 12:11:21 [auto1.nl] INFO: Saving data for GN29290: {'created_time': 1774613481.217498, 'last_price_update_time': 1774613481.217509, 'auction_closing_time': 1774717160.0}
2026-03-27 12:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='GN29290') HTTP/1.1" 204 0
2026-03-27 12:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg06%252Fd2%252F06d2dd16642358e8b7088b828e0fb47d%252Fpa%252FBM13348_6911ef15a51560b5e384d59de03b9373.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:11:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/d2/06d2dd16642358e8b7088b828e0fb47d/pa/BM13348_6911ef15a51560b5e384d59de03b9373.jpg not downloaded yet
2026-03-27 12:11:21 [auto1.nl] INFO: Found listing with ID: SX81397
2026-03-27 12:11:21 [auto1.nl] INFO: Found listing with ID: PM08403
2026-03-27 12:11:21 [auto1.nl] INFO: Found listing with ID: BN28689
2026-03-27 12:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BN28689%27 HTTP/1.1" 200 None
2026-03-27 12:11:21 [auto1.nl] INFO: Scrape type for BN28689: 0
2026-03-27 12:11:21 [auto1.nl] INFO: Found listing with ID: NX58095
2026-03-27 12:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NX58095%27 HTTP/1.1" 200 None
2026-03-27 12:11:21 [auto1.nl] INFO: Scrape type for NX58095: 0
2026-03-27 12:11:21 [auto1.nl] INFO: Found listing with ID: UE02482
2026-03-27 12:11:21 [auto1.nl] INFO: Found listing with ID: AD04128
2026-03-27 12:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AD04128%27 HTTP/1.1" 200 None
2026-03-27 12:11:21 [auto1.nl] INFO: Scrape type for AD04128: 0
2026-03-27 12:11:21 [auto1.nl] INFO: Found listing with ID: XU05010
2026-03-27 12:11:21 [auto1.nl] INFO: Found listing with ID: FD16016
2026-03-27 12:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FD16016%27 HTTP/1.1" 200 None
2026-03-27 12:11:21 [auto1.nl] INFO: Scrape type for FD16016: 0
2026-03-27 12:11:21 [auto1.nl] INFO: Found listing with ID: PS09006
2026-03-27 12:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PS09006%27 HTTP/1.1" 200 None
2026-03-27 12:11:21 [auto1.nl] INFO: Scrape type for PS09006: 0
2026-03-27 12:11:21 [auto1.nl] INFO: Found listing with ID: TT16898
2026-03-27 12:11:21 [auto1.nl] INFO: Found listing with ID: RJ64387
2026-03-27 12:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RJ64387%27 HTTP/1.1" 200 None
2026-03-27 12:11:21 [auto1.nl] INFO: Scrape type for RJ64387: 0
2026-03-27 12:11:21 [auto1.nl] INFO: Found listing with ID: DN23343
2026-03-27 12:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DN23343%27 HTTP/1.1" 200 None
2026-03-27 12:11:21 [auto1.nl] INFO: Scrape type for DN23343: 0
2026-03-27 12:11:21 [auto1.nl] INFO: Found listing with ID: TV49016
2026-03-27 12:11:21 [auto1.nl] INFO: Found listing with ID: BU17435
2026-03-27 12:11:21 [auto1.nl] INFO: Found listing with ID: MW67597
2026-03-27 12:11:21 [auto1.nl] INFO: Found listing with ID: UH74159
2026-03-27 12:11:21 [auto1.nl] INFO: Found listing with ID: MX87704
2026-03-27 12:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MX87704%27 HTTP/1.1" 200 None
2026-03-27 12:11:21 [auto1.nl] INFO: Scrape type for MX87704: 0
2026-03-27 12:11:21 [auto1.nl] INFO: Found listing with ID: ZF00189
2026-03-27 12:11:21 [auto1.nl] INFO: Found listing with ID: PC25819
2026-03-27 12:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PC25819%27 HTTP/1.1" 200 None
2026-03-27 12:11:21 [auto1.nl] INFO: Scrape type for PC25819: 0
2026-03-27 12:11:21 [auto1.nl] INFO: Found listing with ID: SA52781
2026-03-27 12:11:21 [auto1.nl] INFO: Found listing with ID: PG05474
2026-03-27 12:11:21 [auto1.nl] INFO: Found listing with ID: TX41951
2026-03-27 12:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TX41951%27 HTTP/1.1" 200 None
2026-03-27 12:11:21 [auto1.nl] INFO: Scrape type for TX41951: 0
2026-03-27 12:11:21 [auto1.nl] INFO: Found listing with ID: PB89826
2026-03-27 12:11:21 [auto1.nl] INFO: Found listing with ID: RP69884
2026-03-27 12:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RP69884%27 HTTP/1.1" 200 None
2026-03-27 12:11:21 [auto1.nl] INFO: Scrape type for RP69884: 0
2026-03-27 12:11:21 [auto1.nl] INFO: Found listing with ID: WF43043
2026-03-27 12:11:21 [auto1.nl] INFO: Found listing with ID: CG74252
2026-03-27 12:11:21 [auto1.nl] INFO: Found listing with ID: UA29680
2026-03-27 12:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UA29680%27 HTTP/1.1" 200 None
2026-03-27 12:11:21 [auto1.nl] INFO: Scrape type for UA29680: 0
2026-03-27 12:11:21 [auto1.nl] INFO: Found listing with ID: YF67230
2026-03-27 12:11:21 [auto1.nl] INFO: Found listing with ID: DA68002
2026-03-27 12:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DA68002%27 HTTP/1.1" 200 None
2026-03-27 12:11:21 [auto1.nl] INFO: Scrape type for DA68002: 0
2026-03-27 12:11:21 [auto1.nl] INFO: Found listing with ID: RF26708
2026-03-27 12:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RF26708%27 HTTP/1.1" 200 None
2026-03-27 12:11:21 [auto1.nl] INFO: Scrape type for RF26708: 0
2026-03-27 12:11:21 [auto1.nl] INFO: Found listing with ID: YZ87592
2026-03-27 12:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YZ87592%27 HTTP/1.1" 200 None
2026-03-27 12:11:21 [auto1.nl] INFO: Scrape type for YZ87592: 0
2026-03-27 12:11:21 [auto1.nl] INFO: Found listing with ID: PB06350
2026-03-27 12:11:21 [auto1.nl] INFO: Found listing with ID: AT48749
2026-03-27 12:11:21 [auto1.nl] INFO: Found listing with ID: CJ31369
2026-03-27 12:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CJ31369%27 HTTP/1.1" 200 None
2026-03-27 12:11:21 [auto1.nl] INFO: Scrape type for CJ31369: 0
2026-03-27 12:11:21 [auto1.nl] INFO: Found listing with ID: PA83698
2026-03-27 12:11:21 [auto1.nl] INFO: Found listing with ID: CK25026
2026-03-27 12:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CK25026%27 HTTP/1.1" 200 None
2026-03-27 12:11:21 [auto1.nl] INFO: Scrape type for CK25026: 0
2026-03-27 12:11:21 [auto1.nl] INFO: Found listing with ID: YR08683
2026-03-27 12:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YR08683%27 HTTP/1.1" 200 None
2026-03-27 12:11:21 [auto1.nl] INFO: Scrape type for YR08683: 0
2026-03-27 12:11:21 [auto1.nl] INFO: Found listing with ID: KN68466
2026-03-27 12:11:21 [auto1.nl] INFO: Found listing with ID: DH15529
2026-03-27 12:11:21 [auto1.nl] INFO: Found listing with ID: CM88074
2026-03-27 12:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CM88074%27 HTTP/1.1" 200 None
2026-03-27 12:11:21 [auto1.nl] INFO: Scrape type for CM88074: 0
2026-03-27 12:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg41%252F58%252F4158e35b51c530a5e50603fa3ff1822a%252Fpa%252FMD45251_941ef2a455767a8b4f9eb9e7812d0ef6.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:11:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img41/58/4158e35b51c530a5e50603fa3ff1822a/pa/MD45251_941ef2a455767a8b4f9eb9e7812d0ef6.jpg not downloaded yet
2026-03-27 12:11:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img06/d2/06d2dd16642358e8b7088b828e0fb47d/pa/BM13348_f3ceb46d4cb559026a144362c79dafe2.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:11:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img06/d2/06d2dd16642358e8b7088b828e0fb47d/pa/BM13348_42be10a9145da5c016d53a93e95965c3.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg06%252Fd2%252F06d2dd16642358e8b7088b828e0fb47d%252Fpa%252FBM13348_93b459e748700b16f22d74c639e9dc86.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:11:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/d2/06d2dd16642358e8b7088b828e0fb47d/pa/BM13348_93b459e748700b16f22d74c639e9dc86.jpg not downloaded yet
2026-03-27 12:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg41%252F58%252F4158e35b51c530a5e50603fa3ff1822a%252Fpa%252FMD45251_27451980f7dbde12fe3364e801e816d6.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:11:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img41/58/4158e35b51c530a5e50603fa3ff1822a/pa/MD45251_27451980f7dbde12fe3364e801e816d6.jpg not downloaded yet
2026-03-27 12:11:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/EY85081> (referer: https://www.auto1.com/v1/car-details-view/EY85081/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 12:11:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:11:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7cfe0fb5d0>
2026-03-27 12:11:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:11:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:11:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:11:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6e57e3dd-efcf-52e5-8a14-6ed566443adc/6e57e3dd-efcf-52e5-8a14-6ed566443adc_image_0.jpg HTTP/1.1" 201 0
2026-03-27 12:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg06%252Fd2%252F06d2dd16642358e8b7088b828e0fb47d%252Fpa%252FBM13348_98574d23e9a1b261c0781eeef5fabf7c.jpg') HTTP/1.1" 204 0
2026-03-27 12:11:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/d2/06d2dd16642358e8b7088b828e0fb47d/pa/BM13348_98574d23e9a1b261c0781eeef5fabf7c.jpg saved to cache
2026-03-27 12:11:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6e57e3dd-efcf-52e5-8a14-6ed566443adc
2026-03-27 12:11:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:11:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7cfe096390>
2026-03-27 12:11:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:11:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:11:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:11:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aa8b94a4-a373-5f9e-a5de-2e5c9e5565f9/aa8b94a4-a373-5f9e-a5de-2e5c9e5565f9_image_8.jpg HTTP/1.1" 201 0
2026-03-27 12:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252F80%252F65805ffbc2f187043f051c911130400b%252Fpa%252FBG27703_b23872d03e5bc583630f59759a944ec6.jpg') HTTP/1.1" 204 0
2026-03-27 12:11:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/80/65805ffbc2f187043f051c911130400b/pa/BG27703_b23872d03e5bc583630f59759a944ec6.jpg saved to cache
2026-03-27 12:11:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item aa8b94a4-a373-5f9e-a5de-2e5c9e5565f9
2026-03-27 12:11:21 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 12:11:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/CT81231> (referer: https://www.auto1.com/v1/car-details-view/CT81231/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 12:11:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/SY10793> (referer: https://www.auto1.com/v1/car-details-view/SY10793/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 12:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg06%252Fd2%252F06d2dd16642358e8b7088b828e0fb47d%252Fpa%252FBM13348_d6e21f50f265133eb6ec8a999b0db1d5.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:11:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/d2/06d2dd16642358e8b7088b828e0fb47d/pa/BM13348_d6e21f50f265133eb6ec8a999b0db1d5.jpg not downloaded yet
2026-03-27 12:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg41%252F58%252F4158e35b51c530a5e50603fa3ff1822a%252Fpa%252FMD45251_3219fe17adcaf2e88c2b02a6bf17d456.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:11:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img41/58/4158e35b51c530a5e50603fa3ff1822a/pa/MD45251_3219fe17adcaf2e88c2b02a6bf17d456.jpg not downloaded yet
2026-03-27 12:11:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:11:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7cfdf03c90>
2026-03-27 12:11:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:11:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:11:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:11:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6e57e3dd-efcf-52e5-8a14-6ed566443adc/6e57e3dd-efcf-52e5-8a14-6ed566443adc_image_3.jpg HTTP/1.1" 201 0
2026-03-27 12:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg06%252Fd2%252F06d2dd16642358e8b7088b828e0fb47d%252Fpa%252FBM13348_f3ceb46d4cb559026a144362c79dafe2.jpg') HTTP/1.1" 204 0
2026-03-27 12:11:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/d2/06d2dd16642358e8b7088b828e0fb47d/pa/BM13348_f3ceb46d4cb559026a144362c79dafe2.jpg saved to cache
2026-03-27 12:11:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 6e57e3dd-efcf-52e5-8a14-6ed566443adc
2026-03-27 12:11:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:11:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7cfce772d0>
2026-03-27 12:11:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:11:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:11:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:11:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6e57e3dd-efcf-52e5-8a14-6ed566443adc/6e57e3dd-efcf-52e5-8a14-6ed566443adc_image_2.jpg HTTP/1.1" 201 0
2026-03-27 12:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg06%252Fd2%252F06d2dd16642358e8b7088b828e0fb47d%252Fpa%252FBM13348_42be10a9145da5c016d53a93e95965c3.jpg') HTTP/1.1" 204 0
2026-03-27 12:11:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/d2/06d2dd16642358e8b7088b828e0fb47d/pa/BM13348_42be10a9145da5c016d53a93e95965c3.jpg saved to cache
2026-03-27 12:11:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 6e57e3dd-efcf-52e5-8a14-6ed566443adc
2026-03-27 12:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg06%252Fd2%252F06d2dd16642358e8b7088b828e0fb47d%252Fpa%252FBM13348_8558144cd693861fa1656924e3250ff3.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:11:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/d2/06d2dd16642358e8b7088b828e0fb47d/pa/BM13348_8558144cd693861fa1656924e3250ff3.jpg not downloaded yet
2026-03-27 12:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg41%252F58%252F4158e35b51c530a5e50603fa3ff1822a%252Fpa%252FMD45251_672aacf52a0de78c17433fc342944b1c.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:11:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img41/58/4158e35b51c530a5e50603fa3ff1822a/pa/MD45251_672aacf52a0de78c17433fc342944b1c.jpg not downloaded yet
2026-03-27 12:11:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 608255fa-49ac-5b03-af1c-6a8855f26943 with identifier: EY85081
2026-03-27 12:11:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 608255fa-49ac-5b03-af1c-6a8855f26943 with scrape type 1
2026-03-27 12:11:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 608255fa-49ac-5b03-af1c-6a8855f26943
2026-03-27 12:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4e%252Fee%252F4eee94dccf92a4a4fd339ba028bda768%252Fpa%252FEY85081_2b9705b75a680b903004c7f63d3c76ae.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:11:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/ee/4eee94dccf92a4a4fd339ba028bda768/pa/EY85081_2b9705b75a680b903004c7f63d3c76ae.jpg not downloaded yet
2026-03-27 12:11:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img41/58/4158e35b51c530a5e50603fa3ff1822a/pa/MD45251_4bb3c9af338cd71eb06c85b7488a6099.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg41%252F58%252F4158e35b51c530a5e50603fa3ff1822a%252Fpa%252FMD45251_89d1a7f01911f44a06078857fe3fd410.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:11:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img41/58/4158e35b51c530a5e50603fa3ff1822a/pa/MD45251_89d1a7f01911f44a06078857fe3fd410.jpg not downloaded yet
2026-03-27 12:11:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img06/d2/06d2dd16642358e8b7088b828e0fb47d/pa/BM13348_6911ef15a51560b5e384d59de03b9373.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4e%252Fee%252F4eee94dccf92a4a4fd339ba028bda768%252Fpa%252FEY85081_b05c606ac63aaa31d30ce95a122637a5.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:11:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/ee/4eee94dccf92a4a4fd339ba028bda768/pa/EY85081_b05c606ac63aaa31d30ce95a122637a5.jpg not downloaded yet
2026-03-27 12:11:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img41/58/4158e35b51c530a5e50603fa3ff1822a/pa/MD45251_941ef2a455767a8b4f9eb9e7812d0ef6.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg41%252F58%252F4158e35b51c530a5e50603fa3ff1822a%252Fpa%252FMD45251_252fd09681d45e75eaa4b30948c54079.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:11:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img41/58/4158e35b51c530a5e50603fa3ff1822a/pa/MD45251_252fd09681d45e75eaa4b30948c54079.jpg not downloaded yet
2026-03-27 12:11:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/BV58634> (referer: https://www.auto1.com/v1/car-details-view/BV58634/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 12:11:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f2c318cb-82eb-5ef6-9ddf-86744bf6d895 with identifier: CT81231
2026-03-27 12:11:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f2c318cb-82eb-5ef6-9ddf-86744bf6d895 with scrape type 1
2026-03-27 12:11:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f2c318cb-82eb-5ef6-9ddf-86744bf6d895
2026-03-27 12:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252F7e%252Fc67e693a5169c3780752d681b2a56286%252Fpa%252FCT81231_95da80e8778d5442c3e3c3cca10809f7.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:11:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/7e/c67e693a5169c3780752d681b2a56286/pa/CT81231_95da80e8778d5442c3e3c3cca10809f7.jpg not downloaded yet
2026-03-27 12:11:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 69eeae17-cb4c-5500-8736-e5d694b982b9 with identifier: SY10793
2026-03-27 12:11:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 69eeae17-cb4c-5500-8736-e5d694b982b9 with scrape type 1
2026-03-27 12:11:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 69eeae17-cb4c-5500-8736-e5d694b982b9
2026-03-27 12:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg85%252F56%252F8556b6551144a93944e61dfdfeca0173%252Fpa%252FSY10793_2c6692f20dc6f405a4dfc02ad43b8694.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:11:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/56/8556b6551144a93944e61dfdfeca0173/pa/SY10793_2c6692f20dc6f405a4dfc02ad43b8694.jpg already downloaded
2026-03-27 12:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg85%252F56%252F8556b6551144a93944e61dfdfeca0173%252Fpa%252FSY10793_3c3a2e86469200c04ae5b02e7c08092a.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:11:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/56/8556b6551144a93944e61dfdfeca0173/pa/SY10793_3c3a2e86469200c04ae5b02e7c08092a.jpg already downloaded
2026-03-27 12:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg85%252F56%252F8556b6551144a93944e61dfdfeca0173%252Fpa%252FSY10793_f58e3fcb206f2e7ac31c84cfaec50104.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:11:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/56/8556b6551144a93944e61dfdfeca0173/pa/SY10793_f58e3fcb206f2e7ac31c84cfaec50104.jpg already downloaded
2026-03-27 12:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg85%252F56%252F8556b6551144a93944e61dfdfeca0173%252Fpa%252FSY10793_85a0656fe4fc6b595d5d97b30286117b.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:11:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/56/8556b6551144a93944e61dfdfeca0173/pa/SY10793_85a0656fe4fc6b595d5d97b30286117b.jpg already downloaded
2026-03-27 12:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg85%252F56%252F8556b6551144a93944e61dfdfeca0173%252Fpa%252FSY10793_25d2c7dd5f14be97d4a9dc9ba185e755.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:11:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/56/8556b6551144a93944e61dfdfeca0173/pa/SY10793_25d2c7dd5f14be97d4a9dc9ba185e755.jpg already downloaded
2026-03-27 12:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg85%252F56%252F8556b6551144a93944e61dfdfeca0173%252Fpa%252FSY10793_a7af041dc8c2967464463006978cd582.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:11:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/56/8556b6551144a93944e61dfdfeca0173/pa/SY10793_a7af041dc8c2967464463006978cd582.jpg already downloaded
2026-03-27 12:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg85%252F56%252F8556b6551144a93944e61dfdfeca0173%252Fpa%252FSY10793_a0f1144e5e6871fe1ee54bbe0fbe61b6.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:11:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/56/8556b6551144a93944e61dfdfeca0173/pa/SY10793_a0f1144e5e6871fe1ee54bbe0fbe61b6.jpg already downloaded
2026-03-27 12:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg85%252F56%252F8556b6551144a93944e61dfdfeca0173%252Fpa%252FSY10793_54e4de242de39145aae8a3c88a8b127d.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:11:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/56/8556b6551144a93944e61dfdfeca0173/pa/SY10793_54e4de242de39145aae8a3c88a8b127d.jpg already downloaded
2026-03-27 12:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg85%252F56%252F8556b6551144a93944e61dfdfeca0173%252Fpa%252FSY10793_0e1cb10a4ea07808eaf5ed5976f3ae8a.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:11:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/56/8556b6551144a93944e61dfdfeca0173/pa/SY10793_0e1cb10a4ea07808eaf5ed5976f3ae8a.jpg already downloaded
2026-03-27 12:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg85%252F56%252F8556b6551144a93944e61dfdfeca0173%252Fpa%252FSY10793_71aaee2a4928761a86a549c0be9d6be6.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:11:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img85/56/8556b6551144a93944e61dfdfeca0173/pa/SY10793_71aaee2a4928761a86a549c0be9d6be6.jpg already downloaded
2026-03-27 12:11:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 69eeae17-cb4c-5500-8736-e5d694b982b9, identifier: SY10793
2026-03-27 12:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4e%252Fee%252F4eee94dccf92a4a4fd339ba028bda768%252Fpa%252FEY85081_fbf96edd144bb310f1929539d9a0358a.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:11:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/ee/4eee94dccf92a4a4fd339ba028bda768/pa/EY85081_fbf96edd144bb310f1929539d9a0358a.jpg not downloaded yet
2026-03-27 12:11:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 69eeae17-cb4c-5500-8736-e5d694b982b9 with identifier: SY10793
2026-03-27 12:11:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 69eeae17-cb4c-5500-8736-e5d694b982b9 with identifier: SY10793
2026-03-27 12:11:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 69eeae17-cb4c-5500-8736-e5d694b982b9 with identifier: SY10793 to the API
2026-03-27 12:11:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 12:11:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 12:11:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/SY10793>
{'auction_title': '',
 'c_o_2_emission_value': 120,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.4L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:50:09Z',
 'fuel_type': 'petrol',
 'id': '69eeae17-cb4c-5500-8736-e5d694b982b9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'H578TT',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SY10793',
 'listing': 'auction',
 'location': 'NL, Oosterhout',
 'make': 'Seat',
 'model': 'Leon',
 'odometer': 197754,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img85/56/8556b6551144a93944e61dfdfeca0173/pa/SY10793_2c6692f20dc6f405a4dfc02ad43b8694.jpg',
                'https://img-pa.auto1.com/img85/56/8556b6551144a93944e61dfdfeca0173/pa/SY10793_3c3a2e86469200c04ae5b02e7c08092a.jpg',
                'https://img-pa.auto1.com/img85/56/8556b6551144a93944e61dfdfeca0173/pa/SY10793_f58e3fcb206f2e7ac31c84cfaec50104.jpg',
                'https://img-pa.auto1.com/img85/56/8556b6551144a93944e61dfdfeca0173/pa/SY10793_85a0656fe4fc6b595d5d97b30286117b.jpg',
                'https://img-pa.auto1.com/img85/56/8556b6551144a93944e61dfdfeca0173/pa/SY10793_25d2c7dd5f14be97d4a9dc9ba185e755.jpg',
                'https://img-pa.auto1.com/img85/56/8556b6551144a93944e61dfdfeca0173/pa/SY10793_a7af041dc8c2967464463006978cd582.jpg',
                'https://img-pa.auto1.com/img85/56/8556b6551144a93944e61dfdfeca0173/pa/SY10793_a0f1144e5e6871fe1ee54bbe0fbe61b6.jpg',
                'https://img-pa.auto1.com/img85/56/8556b6551144a93944e61dfdfeca0173/pa/SY10793_54e4de242de39145aae8a3c88a8b127d.jpg',
                'https://img-pa.auto1.com/img85/56/8556b6551144a93944e61dfdfeca0173/pa/SY10793_0e1cb10a4ea07808eaf5ed5976f3ae8a.jpg',
                'https://img-pa.auto1.com/img85/56/8556b6551144a93944e61dfdfeca0173/pa/SY10793_71aaee2a4928761a86a549c0be9d6be6.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_69eeae17-cb4c-5500-8736-e5d694b982b9/69eeae17-cb4c-5500-8736-e5d694b982b9_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79038,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img85/56/8556b6551144a93944e61dfdfeca0173/pa/SY10793_2c6692f20dc6f405a4dfc02ad43b8694.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_69eeae17-cb4c-5500-8736-e5d694b982b9/69eeae17-cb4c-5500-8736-e5d694b982b9_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 86723,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img85/56/8556b6551144a93944e61dfdfeca0173/pa/SY10793_3c3a2e86469200c04ae5b02e7c08092a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_69eeae17-cb4c-5500-8736-e5d694b982b9/69eeae17-cb4c-5500-8736-e5d694b982b9_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77813,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img85/56/8556b6551144a93944e61dfdfeca0173/pa/SY10793_f58e3fcb206f2e7ac31c84cfaec50104.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_69eeae17-cb4c-5500-8736-e5d694b982b9/69eeae17-cb4c-5500-8736-e5d694b982b9_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77184,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img85/56/8556b6551144a93944e61dfdfeca0173/pa/SY10793_85a0656fe4fc6b595d5d97b30286117b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_69eeae17-cb4c-5500-8736-e5d694b982b9/69eeae17-cb4c-5500-8736-e5d694b982b9_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73483,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img85/56/8556b6551144a93944e61dfdfeca0173/pa/SY10793_25d2c7dd5f14be97d4a9dc9ba185e755.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_69eeae17-cb4c-5500-8736-e5d694b982b9/69eeae17-cb4c-5500-8736-e5d694b982b9_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76170,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img85/56/8556b6551144a93944e61dfdfeca0173/pa/SY10793_a7af041dc8c2967464463006978cd582.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_69eeae17-cb4c-5500-8736-e5d694b982b9/69eeae17-cb4c-5500-8736-e5d694b982b9_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57725,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img85/56/8556b6551144a93944e61dfdfeca0173/pa/SY10793_a0f1144e5e6871fe1ee54bbe0fbe61b6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_69eeae17-cb4c-5500-8736-e5d694b982b9/69eeae17-cb4c-5500-8736-e5d694b982b9_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83743,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img85/56/8556b6551144a93944e61dfdfeca0173/pa/SY10793_54e4de242de39145aae8a3c88a8b127d.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_69eeae17-cb4c-5500-8736-e5d694b982b9/69eeae17-cb4c-5500-8736-e5d694b982b9_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76213,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img85/56/8556b6551144a93944e61dfdfeca0173/pa/SY10793_0e1cb10a4ea07808eaf5ed5976f3ae8a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_69eeae17-cb4c-5500-8736-e5d694b982b9/69eeae17-cb4c-5500-8736-e5d694b982b9_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67102,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img85/56/8556b6551144a93944e61dfdfeca0173/pa/SY10793_71aaee2a4928761a86a549c0be9d6be6.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2016-06-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Seat Leon 1.4 TSI ACT FR',
 'transmission': 'automatic',
 'trim': 'FR',
 'year': 2016}
2026-03-27 12:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SY10793%27 HTTP/1.1" 200 None
2026-03-27 12:11:22 [auto1.nl] INFO: Saving data for SY10793: {'created_time': 1774613482.730974, 'last_price_update_time': 1774613482.730988, 'auction_closing_time': 1774716609.0}
2026-03-27 12:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='SY10793') HTTP/1.1" 204 0
2026-03-27 12:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg41%252F58%252F4158e35b51c530a5e50603fa3ff1822a%252Fpa%252FMD45251_b56e989fc5cca3f523e6f140e0035d65.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:11:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img41/58/4158e35b51c530a5e50603fa3ff1822a/pa/MD45251_b56e989fc5cca3f523e6f140e0035d65.jpg not downloaded yet
2026-03-27 12:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252F7e%252Fc67e693a5169c3780752d681b2a56286%252Fpa%252FCT81231_c29898ace457fc886696048749797a5e.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:11:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/7e/c67e693a5169c3780752d681b2a56286/pa/CT81231_c29898ace457fc886696048749797a5e.jpg not downloaded yet
2026-03-27 12:11:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img41/58/4158e35b51c530a5e50603fa3ff1822a/pa/MD45251_27451980f7dbde12fe3364e801e816d6.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4e%252Fee%252F4eee94dccf92a4a4fd339ba028bda768%252Fpa%252FEY85081_e159e8999cd72935b95e2db0ffee530c.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:11:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/ee/4eee94dccf92a4a4fd339ba028bda768/pa/EY85081_e159e8999cd72935b95e2db0ffee530c.jpg not downloaded yet
2026-03-27 12:11:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/ES69537> (referer: https://www.auto1.com/v1/car-details-view/ES69537/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 12:11:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/UF96545> (referer: https://www.auto1.com/v1/car-details-view/UF96545/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 12:11:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:11:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7cfe052e50>
2026-03-27 12:11:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:11:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:11:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:11:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_666aa210-f426-54cd-a1d4-3adb8819bfed/666aa210-f426-54cd-a1d4-3adb8819bfed_image_0.jpg HTTP/1.1" 201 0
2026-03-27 12:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg41%252F58%252F4158e35b51c530a5e50603fa3ff1822a%252Fpa%252FMD45251_4bb3c9af338cd71eb06c85b7488a6099.jpg') HTTP/1.1" 204 0
2026-03-27 12:11:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img41/58/4158e35b51c530a5e50603fa3ff1822a/pa/MD45251_4bb3c9af338cd71eb06c85b7488a6099.jpg saved to cache
2026-03-27 12:11:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 666aa210-f426-54cd-a1d4-3adb8819bfed
2026-03-27 12:11:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:11:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7cfe17f150>
2026-03-27 12:11:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:11:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:11:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:11:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6e57e3dd-efcf-52e5-8a14-6ed566443adc/6e57e3dd-efcf-52e5-8a14-6ed566443adc_image_6.jpg HTTP/1.1" 201 0
2026-03-27 12:11:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg06%252Fd2%252F06d2dd16642358e8b7088b828e0fb47d%252Fpa%252FBM13348_6911ef15a51560b5e384d59de03b9373.jpg') HTTP/1.1" 204 0
2026-03-27 12:11:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/d2/06d2dd16642358e8b7088b828e0fb47d/pa/BM13348_6911ef15a51560b5e384d59de03b9373.jpg saved to cache
2026-03-27 12:11:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 6e57e3dd-efcf-52e5-8a14-6ed566443adc
2026-03-27 12:11:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:11:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7cfe195c10>
2026-03-27 12:11:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:11:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:11:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:11:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_666aa210-f426-54cd-a1d4-3adb8819bfed/666aa210-f426-54cd-a1d4-3adb8819bfed_image_1.jpg HTTP/1.1" 201 0
2026-03-27 12:11:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg41%252F58%252F4158e35b51c530a5e50603fa3ff1822a%252Fpa%252FMD45251_941ef2a455767a8b4f9eb9e7812d0ef6.jpg') HTTP/1.1" 204 0
2026-03-27 12:11:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img41/58/4158e35b51c530a5e50603fa3ff1822a/pa/MD45251_941ef2a455767a8b4f9eb9e7812d0ef6.jpg saved to cache
2026-03-27 12:11:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 666aa210-f426-54cd-a1d4-3adb8819bfed
2026-03-27 12:11:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 34fb2b73-5837-529b-a0ca-24316a72a084 with identifier: BV58634
2026-03-27 12:11:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 34fb2b73-5837-529b-a0ca-24316a72a084 with scrape type 1
2026-03-27 12:11:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 5 photos for item 34fb2b73-5837-529b-a0ca-24316a72a084
2026-03-27 12:11:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg64%252F93%252F64934bf93e30620e93ad947cb0faa26a%252Fpa%252FBV58634_7d740e1a7188bcc382c0f75dd2391f6f.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:11:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/93/64934bf93e30620e93ad947cb0faa26a/pa/BV58634_7d740e1a7188bcc382c0f75dd2391f6f.jpg not downloaded yet
2026-03-27 12:11:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img06/d2/06d2dd16642358e8b7088b828e0fb47d/pa/BM13348_93b459e748700b16f22d74c639e9dc86.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:11:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img41/58/4158e35b51c530a5e50603fa3ff1822a/pa/MD45251_672aacf52a0de78c17433fc342944b1c.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:11:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg41%252F58%252F4158e35b51c530a5e50603fa3ff1822a%252Fpa%252FMD45251_b62a319d48d66234db21acbc4852d5fc.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:11:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img41/58/4158e35b51c530a5e50603fa3ff1822a/pa/MD45251_b62a319d48d66234db21acbc4852d5fc.jpg not downloaded yet
2026-03-27 12:11:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252F7e%252Fc67e693a5169c3780752d681b2a56286%252Fpa%252FCT81231_2004f2a7e1f08a268334b3cfd5a995c6.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:11:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/7e/c67e693a5169c3780752d681b2a56286/pa/CT81231_2004f2a7e1f08a268334b3cfd5a995c6.jpg not downloaded yet
2026-03-27 12:11:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/GL61326> (referer: https://www.auto1.com/v1/car-details-view/GL61326/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 12:11:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4e%252Fee%252F4eee94dccf92a4a4fd339ba028bda768%252Fpa%252FEY85081_04e410b586cebb18aaa5fb0a7614c6a0.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:11:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/ee/4eee94dccf92a4a4fd339ba028bda768/pa/EY85081_04e410b586cebb18aaa5fb0a7614c6a0.jpg not downloaded yet
2026-03-27 12:11:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg64%252F93%252F64934bf93e30620e93ad947cb0faa26a%252Fpa%252FBV58634_3403dff4aee1d9944f1bcf3d475b0472.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:11:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/93/64934bf93e30620e93ad947cb0faa26a/pa/BV58634_3403dff4aee1d9944f1bcf3d475b0472.jpg not downloaded yet
2026-03-27 12:11:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/v1/car-details-view/DZ87358/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 12:11:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg41%252F58%252F4158e35b51c530a5e50603fa3ff1822a%252Fpa%252FMD45251_9338a7d6e23b725c9cb0091947666aec.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:11:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img41/58/4158e35b51c530a5e50603fa3ff1822a/pa/MD45251_9338a7d6e23b725c9cb0091947666aec.jpg not downloaded yet
2026-03-27 12:11:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252F7e%252Fc67e693a5169c3780752d681b2a56286%252Fpa%252FCT81231_d4b153cefe7fa1ee96d2428b764f2a12.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:11:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/7e/c67e693a5169c3780752d681b2a56286/pa/CT81231_d4b153cefe7fa1ee96d2428b764f2a12.jpg not downloaded yet
2026-03-27 12:11:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4e%252Fee%252F4eee94dccf92a4a4fd339ba028bda768%252Fpa%252FEY85081_6da110733f706b50fa3c27544558bd5b.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:11:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/ee/4eee94dccf92a4a4fd339ba028bda768/pa/EY85081_6da110733f706b50fa3c27544558bd5b.jpg not downloaded yet
2026-03-27 12:11:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg64%252F93%252F64934bf93e30620e93ad947cb0faa26a%252Fpa%252FBV58634_a0a7d9b40bd9ed80f9d9a40986dddded.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:11:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/93/64934bf93e30620e93ad947cb0faa26a/pa/BV58634_a0a7d9b40bd9ed80f9d9a40986dddded.jpg not downloaded yet
2026-03-27 12:11:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252F7e%252Fc67e693a5169c3780752d681b2a56286%252Fpa%252FCT81231_3e5c7569c66fe1815a03db86eb75aa92.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:11:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/7e/c67e693a5169c3780752d681b2a56286/pa/CT81231_3e5c7569c66fe1815a03db86eb75aa92.jpg not downloaded yet
2026-03-27 12:11:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:11:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7cfe159550>
2026-03-27 12:11:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:11:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:11:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:11:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_666aa210-f426-54cd-a1d4-3adb8819bfed/666aa210-f426-54cd-a1d4-3adb8819bfed_image_2.jpg HTTP/1.1" 201 0
2026-03-27 12:11:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg41%252F58%252F4158e35b51c530a5e50603fa3ff1822a%252Fpa%252FMD45251_27451980f7dbde12fe3364e801e816d6.jpg') HTTP/1.1" 204 0
2026-03-27 12:11:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img41/58/4158e35b51c530a5e50603fa3ff1822a/pa/MD45251_27451980f7dbde12fe3364e801e816d6.jpg saved to cache
2026-03-27 12:11:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 666aa210-f426-54cd-a1d4-3adb8819bfed
2026-03-27 12:11:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c06f76bb-78a1-59c3-8429-b24b0bd15fe7 with identifier: ES69537
2026-03-27 12:11:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c06f76bb-78a1-59c3-8429-b24b0bd15fe7 with scrape type 1
2026-03-27 12:11:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c06f76bb-78a1-59c3-8429-b24b0bd15fe7
2026-03-27 12:11:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252F9e%252F749e896716e888d54c46ce55bdd030ee%252Fpa%252FES69537_b155f3e7545c92734b59334e2cf8cf9f.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:11:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/9e/749e896716e888d54c46ce55bdd030ee/pa/ES69537_b155f3e7545c92734b59334e2cf8cf9f.jpg not downloaded yet
2026-03-27 12:11:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f1191053-835c-5ec0-bcdc-3ddbaf91671e with identifier: UF96545
2026-03-27 12:11:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f1191053-835c-5ec0-bcdc-3ddbaf91671e with scrape type 1
2026-03-27 12:11:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f1191053-835c-5ec0-bcdc-3ddbaf91671e
2026-03-27 12:11:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg44%252Fe2%252F44e292fee3c547a73ace4234307fb01d%252Fpa%252FUF96545_323f2c890f2b2e727afe5217c321669e.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:11:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img44/e2/44e292fee3c547a73ace4234307fb01d/pa/UF96545_323f2c890f2b2e727afe5217c321669e.jpg already downloaded
2026-03-27 12:11:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg44%252Fe2%252F44e292fee3c547a73ace4234307fb01d%252Fpa%252FUF96545_f9b9d509bf016b9ca7323a64d0ea1e77.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:11:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img44/e2/44e292fee3c547a73ace4234307fb01d/pa/UF96545_f9b9d509bf016b9ca7323a64d0ea1e77.jpg already downloaded
2026-03-27 12:11:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg44%252Fe2%252F44e292fee3c547a73ace4234307fb01d%252Fpa%252FUF96545_5882fec0c949423f2ea8e4d5f38cdeb2.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:11:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img44/e2/44e292fee3c547a73ace4234307fb01d/pa/UF96545_5882fec0c949423f2ea8e4d5f38cdeb2.jpg already downloaded
2026-03-27 12:11:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg44%252Fe2%252F44e292fee3c547a73ace4234307fb01d%252Fpa%252FUF96545_6e091735a86d40964c890d61189f2d8f.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:11:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img44/e2/44e292fee3c547a73ace4234307fb01d/pa/UF96545_6e091735a86d40964c890d61189f2d8f.jpg already downloaded
2026-03-27 12:11:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg44%252Fe2%252F44e292fee3c547a73ace4234307fb01d%252Fpa%252FUF96545_ec2d6d442f0a714c708ae5856f065391.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:11:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img44/e2/44e292fee3c547a73ace4234307fb01d/pa/UF96545_ec2d6d442f0a714c708ae5856f065391.jpg already downloaded
2026-03-27 12:11:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg44%252Fe2%252F44e292fee3c547a73ace4234307fb01d%252Fpa%252FUF96545_c8de3f464076ae1cf45fc7bbcfffaf78.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:11:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img44/e2/44e292fee3c547a73ace4234307fb01d/pa/UF96545_c8de3f464076ae1cf45fc7bbcfffaf78.jpg already downloaded
2026-03-27 12:11:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg44%252Fe2%252F44e292fee3c547a73ace4234307fb01d%252Fpa%252FUF96545_659bd91ab08317a18aff8e171f3fc9da.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:11:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img44/e2/44e292fee3c547a73ace4234307fb01d/pa/UF96545_659bd91ab08317a18aff8e171f3fc9da.jpg already downloaded
2026-03-27 12:11:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg44%252Fe2%252F44e292fee3c547a73ace4234307fb01d%252Fpa%252FUF96545_d3d202b4289edddbad5f139a614b0415.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:11:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img44/e2/44e292fee3c547a73ace4234307fb01d/pa/UF96545_d3d202b4289edddbad5f139a614b0415.jpg already downloaded
2026-03-27 12:11:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg44%252Fe2%252F44e292fee3c547a73ace4234307fb01d%252Fpa%252FUF96545_7ca4a44e0365b12af68fbc42c8c33c13.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:11:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img44/e2/44e292fee3c547a73ace4234307fb01d/pa/UF96545_7ca4a44e0365b12af68fbc42c8c33c13.jpg already downloaded
2026-03-27 12:11:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg44%252Fe2%252F44e292fee3c547a73ace4234307fb01d%252Fpa%252FUF96545_6d4edc7f23df9043ed4fba1b93f95b0f.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:11:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img44/e2/44e292fee3c547a73ace4234307fb01d/pa/UF96545_6d4edc7f23df9043ed4fba1b93f95b0f.jpg already downloaded
2026-03-27 12:11:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: f1191053-835c-5ec0-bcdc-3ddbaf91671e, identifier: UF96545
2026-03-27 12:11:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4e%252Fee%252F4eee94dccf92a4a4fd339ba028bda768%252Fpa%252FEY85081_6b975943da60dee641b4fd8f7831360a.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:11:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/ee/4eee94dccf92a4a4fd339ba028bda768/pa/EY85081_6b975943da60dee641b4fd8f7831360a.jpg not downloaded yet
2026-03-27 12:11:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg64%252F93%252F64934bf93e30620e93ad947cb0faa26a%252Fpa%252FBV58634_7d91cc7cd2f41c7ef6cf5220d9d1d0a0.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:11:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/93/64934bf93e30620e93ad947cb0faa26a/pa/BV58634_7d91cc7cd2f41c7ef6cf5220d9d1d0a0.jpg not downloaded yet
2026-03-27 12:11:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: f1191053-835c-5ec0-bcdc-3ddbaf91671e with identifier: UF96545
2026-03-27 12:11:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: f1191053-835c-5ec0-bcdc-3ddbaf91671e with identifier: UF96545
2026-03-27 12:11:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: f1191053-835c-5ec0-bcdc-3ddbaf91671e with identifier: UF96545 to the API
2026-03-27 12:11:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 12:11:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 12:11:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/UF96545>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'engine_horse_power': 95,
 'expiration_date': '2026-03-28T16:03:47Z',
 'fuel_type': 'petrol',
 'id': 'f1191053-835c-5ec0-bcdc-3ddbaf91671e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'RK751L',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UF96545',
 'listing': 'auction',
 'location': 'NL, Oosterhout',
 'make': 'Audi',
 'model': 'A1 Sportback',
 'odometer': 179029,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 14,
 'photo_urls': ['https://img-pa.auto1.com/img44/e2/44e292fee3c547a73ace4234307fb01d/pa/UF96545_323f2c890f2b2e727afe5217c321669e.jpg',
                'https://img-pa.auto1.com/img44/e2/44e292fee3c547a73ace4234307fb01d/pa/UF96545_f9b9d509bf016b9ca7323a64d0ea1e77.jpg',
                'https://img-pa.auto1.com/img44/e2/44e292fee3c547a73ace4234307fb01d/pa/UF96545_5882fec0c949423f2ea8e4d5f38cdeb2.jpg',
                'https://img-pa.auto1.com/img44/e2/44e292fee3c547a73ace4234307fb01d/pa/UF96545_6e091735a86d40964c890d61189f2d8f.jpg',
                'https://img-pa.auto1.com/img44/e2/44e292fee3c547a73ace4234307fb01d/pa/UF96545_ec2d6d442f0a714c708ae5856f065391.jpg',
                'https://img-pa.auto1.com/img44/e2/44e292fee3c547a73ace4234307fb01d/pa/UF96545_c8de3f464076ae1cf45fc7bbcfffaf78.jpg',
                'https://img-pa.auto1.com/img44/e2/44e292fee3c547a73ace4234307fb01d/pa/UF96545_659bd91ab08317a18aff8e171f3fc9da.jpg',
                'https://img-pa.auto1.com/img44/e2/44e292fee3c547a73ace4234307fb01d/pa/UF96545_d3d202b4289edddbad5f139a614b0415.jpg',
                'https://img-pa.auto1.com/img44/e2/44e292fee3c547a73ace4234307fb01d/pa/UF96545_7ca4a44e0365b12af68fbc42c8c33c13.jpg',
                'https://img-pa.auto1.com/img44/e2/44e292fee3c547a73ace4234307fb01d/pa/UF96545_6d4edc7f23df9043ed4fba1b93f95b0f.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f1191053-835c-5ec0-bcdc-3ddbaf91671e/f1191053-835c-5ec0-bcdc-3ddbaf91671e_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 91831,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img44/e2/44e292fee3c547a73ace4234307fb01d/pa/UF96545_323f2c890f2b2e727afe5217c321669e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f1191053-835c-5ec0-bcdc-3ddbaf91671e/f1191053-835c-5ec0-bcdc-3ddbaf91671e_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79096,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img44/e2/44e292fee3c547a73ace4234307fb01d/pa/UF96545_f9b9d509bf016b9ca7323a64d0ea1e77.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f1191053-835c-5ec0-bcdc-3ddbaf91671e/f1191053-835c-5ec0-bcdc-3ddbaf91671e_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 88872,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img44/e2/44e292fee3c547a73ace4234307fb01d/pa/UF96545_5882fec0c949423f2ea8e4d5f38cdeb2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f1191053-835c-5ec0-bcdc-3ddbaf91671e/f1191053-835c-5ec0-bcdc-3ddbaf91671e_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 46260,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img44/e2/44e292fee3c547a73ace4234307fb01d/pa/UF96545_6e091735a86d40964c890d61189f2d8f.jpg',
             'Width': 450},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f1191053-835c-5ec0-bcdc-3ddbaf91671e/f1191053-835c-5ec0-bcdc-3ddbaf91671e_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 104034,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img44/e2/44e292fee3c547a73ace4234307fb01d/pa/UF96545_ec2d6d442f0a714c708ae5856f065391.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f1191053-835c-5ec0-bcdc-3ddbaf91671e/f1191053-835c-5ec0-bcdc-3ddbaf91671e_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 104169,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img44/e2/44e292fee3c547a73ace4234307fb01d/pa/UF96545_c8de3f464076ae1cf45fc7bbcfffaf78.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f1191053-835c-5ec0-bcdc-3ddbaf91671e/f1191053-835c-5ec0-bcdc-3ddbaf91671e_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68338,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img44/e2/44e292fee3c547a73ace4234307fb01d/pa/UF96545_659bd91ab08317a18aff8e171f3fc9da.jpg',
             'Width': 450},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f1191053-835c-5ec0-bcdc-3ddbaf91671e/f1191053-835c-5ec0-bcdc-3ddbaf91671e_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 56957,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img44/e2/44e292fee3c547a73ace4234307fb01d/pa/UF96545_d3d202b4289edddbad5f139a614b0415.jpg',
             'Width': 450},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f1191053-835c-5ec0-bcdc-3ddbaf91671e/f1191053-835c-5ec0-bcdc-3ddbaf91671e_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 45184,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img44/e2/44e292fee3c547a73ace4234307fb01d/pa/UF96545_7ca4a44e0365b12af68fbc42c8c33c13.jpg',
             'Width': 450},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f1191053-835c-5ec0-bcdc-3ddbaf91671e/f1191053-835c-5ec0-bcdc-3ddbaf91671e_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67725,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img44/e2/44e292fee3c547a73ace4234307fb01d/pa/UF96545_6d4edc7f23df9043ed4fba1b93f95b0f.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-03-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Audi A1 Sportback 1.0 TFSI Attraction',
 'transmission': 'automatic',
 'trim': 'Attraction',
 'year': 2017}
2026-03-27 12:11:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UF96545%27 HTTP/1.1" 200 None
2026-03-27 12:11:23 [auto1.nl] INFO: Saving data for UF96545: {'created_time': 1774613483.970692, 'last_price_update_time': 1774613483.970702, 'auction_closing_time': 1774713827.0}
2026-03-27 12:11:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='UF96545') HTTP/1.1" 204 0
2026-03-27 12:11:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img65/80/65805ffbc2f187043f051c911130400b/pa/BG27703_6e735c0b82e259746020c82b8940b660.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:11:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4e/ee/4eee94dccf92a4a4fd339ba028bda768/pa/EY85081_2b9705b75a680b903004c7f63d3c76ae.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252F7e%252Fc67e693a5169c3780752d681b2a56286%252Fpa%252FCT81231_bf1add53672a07503d90891a7b5e7653.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:11:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/7e/c67e693a5169c3780752d681b2a56286/pa/CT81231_bf1add53672a07503d90891a7b5e7653.jpg not downloaded yet
2026-03-27 12:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252F9e%252F749e896716e888d54c46ce55bdd030ee%252Fpa%252FES69537_f6992353d592641ae1fa38b59600f26a.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:11:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/9e/749e896716e888d54c46ce55bdd030ee/pa/ES69537_f6992353d592641ae1fa38b59600f26a.jpg not downloaded yet
2026-03-27 12:11:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:11:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7cfe07f310>
2026-03-27 12:11:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:11:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:11:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:11:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6e57e3dd-efcf-52e5-8a14-6ed566443adc/6e57e3dd-efcf-52e5-8a14-6ed566443adc_image_7.jpg HTTP/1.1" 201 0
2026-03-27 12:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg06%252Fd2%252F06d2dd16642358e8b7088b828e0fb47d%252Fpa%252FBM13348_93b459e748700b16f22d74c639e9dc86.jpg') HTTP/1.1" 204 0
2026-03-27 12:11:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/d2/06d2dd16642358e8b7088b828e0fb47d/pa/BM13348_93b459e748700b16f22d74c639e9dc86.jpg saved to cache
2026-03-27 12:11:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 6e57e3dd-efcf-52e5-8a14-6ed566443adc
2026-03-27 12:11:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:11:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7cfe096810>
2026-03-27 12:11:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:11:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:11:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:11:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_666aa210-f426-54cd-a1d4-3adb8819bfed/666aa210-f426-54cd-a1d4-3adb8819bfed_image_4.jpg HTTP/1.1" 201 0
2026-03-27 12:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg41%252F58%252F4158e35b51c530a5e50603fa3ff1822a%252Fpa%252FMD45251_672aacf52a0de78c17433fc342944b1c.jpg') HTTP/1.1" 204 0
2026-03-27 12:11:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img41/58/4158e35b51c530a5e50603fa3ff1822a/pa/MD45251_672aacf52a0de78c17433fc342944b1c.jpg saved to cache
2026-03-27 12:11:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 666aa210-f426-54cd-a1d4-3adb8819bfed
2026-03-27 12:11:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 536b061a-4d1f-52ff-bc34-542fbd256f0d with identifier: GL61326
2026-03-27 12:11:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 536b061a-4d1f-52ff-bc34-542fbd256f0d with scrape type 1
2026-03-27 12:11:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 536b061a-4d1f-52ff-bc34-542fbd256f0d
2026-03-27 12:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252F4f%252Fec4fccb1e72592d89eaaead26b433349%252Fpa%252FGL61326_7aa48f5e21c5d94547c569fff4b64db1.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:11:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/4f/ec4fccb1e72592d89eaaead26b433349/pa/GL61326_7aa48f5e21c5d94547c569fff4b64db1.jpg already downloaded
2026-03-27 12:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252F4f%252Fec4fccb1e72592d89eaaead26b433349%252Fpa%252FGL61326_5daf8ef14cbd5c67fd2d8f23af34dea5.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:11:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/4f/ec4fccb1e72592d89eaaead26b433349/pa/GL61326_5daf8ef14cbd5c67fd2d8f23af34dea5.jpg already downloaded
2026-03-27 12:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252F4f%252Fec4fccb1e72592d89eaaead26b433349%252Fpa%252FGL61326_40739d2f64039a023153a6056aee8a45.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:11:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/4f/ec4fccb1e72592d89eaaead26b433349/pa/GL61326_40739d2f64039a023153a6056aee8a45.jpg already downloaded
2026-03-27 12:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252F4f%252Fec4fccb1e72592d89eaaead26b433349%252Fpa%252FGL61326_3544843f701faa8367cc0480120bb2d5.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:11:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/4f/ec4fccb1e72592d89eaaead26b433349/pa/GL61326_3544843f701faa8367cc0480120bb2d5.jpg already downloaded
2026-03-27 12:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252F4f%252Fec4fccb1e72592d89eaaead26b433349%252Fpa%252FGL61326_1d37efe36bf99b35bc0127e5e53efffc.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:11:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/4f/ec4fccb1e72592d89eaaead26b433349/pa/GL61326_1d37efe36bf99b35bc0127e5e53efffc.jpg already downloaded
2026-03-27 12:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252F4f%252Fec4fccb1e72592d89eaaead26b433349%252Fpa%252FGL61326_1d9a2de75093df35fd9523858b2ac572.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:11:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/4f/ec4fccb1e72592d89eaaead26b433349/pa/GL61326_1d9a2de75093df35fd9523858b2ac572.jpg already downloaded
2026-03-27 12:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252F4f%252Fec4fccb1e72592d89eaaead26b433349%252Fpa%252FGL61326_7b974a0f172f07364ce0506d7c767600.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:11:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/4f/ec4fccb1e72592d89eaaead26b433349/pa/GL61326_7b974a0f172f07364ce0506d7c767600.jpg already downloaded
2026-03-27 12:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252F4f%252Fec4fccb1e72592d89eaaead26b433349%252Fpa%252FGL61326_d22ea871b5fe82a010f2cf8486da89ac.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:11:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/4f/ec4fccb1e72592d89eaaead26b433349/pa/GL61326_d22ea871b5fe82a010f2cf8486da89ac.jpg already downloaded
2026-03-27 12:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252F4f%252Fec4fccb1e72592d89eaaead26b433349%252Fpa%252FGL61326_ba1ecb2d5e70ec883183201c015b8e1e.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:11:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/4f/ec4fccb1e72592d89eaaead26b433349/pa/GL61326_ba1ecb2d5e70ec883183201c015b8e1e.jpg already downloaded
2026-03-27 12:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgec%252F4f%252Fec4fccb1e72592d89eaaead26b433349%252Fpa%252FGL61326_ab9a72a741b4c93f25750a747acfdc49.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:11:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgec/4f/ec4fccb1e72592d89eaaead26b433349/pa/GL61326_ab9a72a741b4c93f25750a747acfdc49.jpg already downloaded
2026-03-27 12:11:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 536b061a-4d1f-52ff-bc34-542fbd256f0d, identifier: GL61326
2026-03-27 12:11:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img65/80/65805ffbc2f187043f051c911130400b/pa/BG27703_5c2d652a5dd6d11e09e728ccbc1cace1.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:11:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img41/58/4158e35b51c530a5e50603fa3ff1822a/pa/MD45251_89d1a7f01911f44a06078857fe3fd410.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:11:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4e/ee/4eee94dccf92a4a4fd339ba028bda768/pa/EY85081_b05c606ac63aaa31d30ce95a122637a5.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4e%252Fee%252F4eee94dccf92a4a4fd339ba028bda768%252Fpa%252FEY85081_cc0ebd8f7be3f73525f2c0927683aeef.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:11:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/ee/4eee94dccf92a4a4fd339ba028bda768/pa/EY85081_cc0ebd8f7be3f73525f2c0927683aeef.jpg not downloaded yet
2026-03-27 12:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg64%252F93%252F64934bf93e30620e93ad947cb0faa26a%252Fpa%252FBV58634_cdb821dcf7a169437a8f37b5a1c1df9b.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:11:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/93/64934bf93e30620e93ad947cb0faa26a/pa/BV58634_cdb821dcf7a169437a8f37b5a1c1df9b.jpg not downloaded yet
2026-03-27 12:11:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/WY03082> (referer: https://www.auto1.com/v1/car-details-view/WY03082/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 12:11:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 536b061a-4d1f-52ff-bc34-542fbd256f0d with identifier: GL61326
2026-03-27 12:11:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 536b061a-4d1f-52ff-bc34-542fbd256f0d with identifier: GL61326
2026-03-27 12:11:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 536b061a-4d1f-52ff-bc34-542fbd256f0d with identifier: GL61326 to the API
2026-03-27 12:11:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 12:11:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 12:11:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/GL61326>
{'auction_title': '',
 'c_o_2_emission_value': 162,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '3.0L',
 'engine_horse_power': 205,
 'expiration_date': '2026-03-28T16:04:27Z',
 'fuel_type': 'diesel',
 'id': '536b061a-4d1f-52ff-bc34-542fbd256f0d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': '12XHX1',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GL61326',
 'listing': 'auction',
 'location': 'NL, Venlo',
 'make': 'BMW',
 'model': '5er',
 'odometer': 262671,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/imgec/4f/ec4fccb1e72592d89eaaead26b433349/pa/GL61326_7aa48f5e21c5d94547c569fff4b64db1.jpg',
                'https://img-pa.auto1.com/imgec/4f/ec4fccb1e72592d89eaaead26b433349/pa/GL61326_5daf8ef14cbd5c67fd2d8f23af34dea5.jpg',
                'https://img-pa.auto1.com/imgec/4f/ec4fccb1e72592d89eaaead26b433349/pa/GL61326_40739d2f64039a023153a6056aee8a45.jpg',
                'https://img-pa.auto1.com/imgec/4f/ec4fccb1e72592d89eaaead26b433349/pa/GL61326_3544843f701faa8367cc0480120bb2d5.jpg',
                'https://img-pa.auto1.com/imgec/4f/ec4fccb1e72592d89eaaead26b433349/pa/GL61326_1d37efe36bf99b35bc0127e5e53efffc.jpg',
                'https://img-pa.auto1.com/imgec/4f/ec4fccb1e72592d89eaaead26b433349/pa/GL61326_1d9a2de75093df35fd9523858b2ac572.jpg',
                'https://img-pa.auto1.com/imgec/4f/ec4fccb1e72592d89eaaead26b433349/pa/GL61326_7b974a0f172f07364ce0506d7c767600.jpg',
                'https://img-pa.auto1.com/imgec/4f/ec4fccb1e72592d89eaaead26b433349/pa/GL61326_d22ea871b5fe82a010f2cf8486da89ac.jpg',
                'https://img-pa.auto1.com/imgec/4f/ec4fccb1e72592d89eaaead26b433349/pa/GL61326_ba1ecb2d5e70ec883183201c015b8e1e.jpg',
                'https://img-pa.auto1.com/imgec/4f/ec4fccb1e72592d89eaaead26b433349/pa/GL61326_ab9a72a741b4c93f25750a747acfdc49.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_536b061a-4d1f-52ff-bc34-542fbd256f0d/536b061a-4d1f-52ff-bc34-542fbd256f0d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2609187,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgec/4f/ec4fccb1e72592d89eaaead26b433349/pa/GL61326_7aa48f5e21c5d94547c569fff4b64db1.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_536b061a-4d1f-52ff-bc34-542fbd256f0d/536b061a-4d1f-52ff-bc34-542fbd256f0d_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2621852,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgec/4f/ec4fccb1e72592d89eaaead26b433349/pa/GL61326_5daf8ef14cbd5c67fd2d8f23af34dea5.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_536b061a-4d1f-52ff-bc34-542fbd256f0d/536b061a-4d1f-52ff-bc34-542fbd256f0d_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66261,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgec/4f/ec4fccb1e72592d89eaaead26b433349/pa/GL61326_40739d2f64039a023153a6056aee8a45.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_536b061a-4d1f-52ff-bc34-542fbd256f0d/536b061a-4d1f-52ff-bc34-542fbd256f0d_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58595,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgec/4f/ec4fccb1e72592d89eaaead26b433349/pa/GL61326_3544843f701faa8367cc0480120bb2d5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_536b061a-4d1f-52ff-bc34-542fbd256f0d/536b061a-4d1f-52ff-bc34-542fbd256f0d_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2595679,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgec/4f/ec4fccb1e72592d89eaaead26b433349/pa/GL61326_1d37efe36bf99b35bc0127e5e53efffc.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_536b061a-4d1f-52ff-bc34-542fbd256f0d/536b061a-4d1f-52ff-bc34-542fbd256f0d_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 72945,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgec/4f/ec4fccb1e72592d89eaaead26b433349/pa/GL61326_1d9a2de75093df35fd9523858b2ac572.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_536b061a-4d1f-52ff-bc34-542fbd256f0d/536b061a-4d1f-52ff-bc34-542fbd256f0d_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59008,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgec/4f/ec4fccb1e72592d89eaaead26b433349/pa/GL61326_7b974a0f172f07364ce0506d7c767600.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_536b061a-4d1f-52ff-bc34-542fbd256f0d/536b061a-4d1f-52ff-bc34-542fbd256f0d_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71584,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgec/4f/ec4fccb1e72592d89eaaead26b433349/pa/GL61326_d22ea871b5fe82a010f2cf8486da89ac.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_536b061a-4d1f-52ff-bc34-542fbd256f0d/536b061a-4d1f-52ff-bc34-542fbd256f0d_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71757,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgec/4f/ec4fccb1e72592d89eaaead26b433349/pa/GL61326_ba1ecb2d5e70ec883183201c015b8e1e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_536b061a-4d1f-52ff-bc34-542fbd256f0d/536b061a-4d1f-52ff-bc34-542fbd256f0d_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2618190,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgec/4f/ec4fccb1e72592d89eaaead26b433349/pa/GL61326_ab9a72a741b4c93f25750a747acfdc49.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2011-06-07',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 5er 525d',
 'transmission': 'automatic',
 'trim': '',
 'year': 2011}
2026-03-27 12:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GL61326%27 HTTP/1.1" 200 None
2026-03-27 12:11:24 [auto1.nl] INFO: Saving data for GL61326: {'created_time': 1774613484.779007, 'last_price_update_time': 1774613484.779018, 'auction_closing_time': 1774713867.0}
2026-03-27 12:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='GL61326') HTTP/1.1" 204 0
2026-03-27 12:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252F7e%252Fc67e693a5169c3780752d681b2a56286%252Fpa%252FCT81231_45d05baa62917dfcde88f544dc4f30ba.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:11:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/7e/c67e693a5169c3780752d681b2a56286/pa/CT81231_45d05baa62917dfcde88f544dc4f30ba.jpg not downloaded yet
2026-03-27 12:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252F9e%252F749e896716e888d54c46ce55bdd030ee%252Fpa%252FES69537_0e4d09e779349017551011d2a1a0535c.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:11:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/9e/749e896716e888d54c46ce55bdd030ee/pa/ES69537_0e4d09e779349017551011d2a1a0535c.jpg not downloaded yet
2026-03-27 12:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4e%252Fee%252F4eee94dccf92a4a4fd339ba028bda768%252Fpa%252FEY85081_3ef598096dea7f54a5d2cd784cf3ee02.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:11:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/ee/4eee94dccf92a4a4fd339ba028bda768/pa/EY85081_3ef598096dea7f54a5d2cd784cf3ee02.jpg not downloaded yet
2026-03-27 12:11:24 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 12:11:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:11:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7cfe0cd450>
2026-03-27 12:11:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:11:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:11:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:11:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aa8b94a4-a373-5f9e-a5de-2e5c9e5565f9/aa8b94a4-a373-5f9e-a5de-2e5c9e5565f9_image_2.jpg HTTP/1.1" 201 0
2026-03-27 12:11:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252F80%252F65805ffbc2f187043f051c911130400b%252Fpa%252FBG27703_6e735c0b82e259746020c82b8940b660.jpg') HTTP/1.1" 204 0
2026-03-27 12:11:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/80/65805ffbc2f187043f051c911130400b/pa/BG27703_6e735c0b82e259746020c82b8940b660.jpg saved to cache
2026-03-27 12:11:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item aa8b94a4-a373-5f9e-a5de-2e5c9e5565f9
2026-03-27 12:11:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:11:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7cfe235ed0>
2026-03-27 12:11:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:11:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:11:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:11:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_608255fa-49ac-5b03-af1c-6a8855f26943/608255fa-49ac-5b03-af1c-6a8855f26943_image_0.jpg HTTP/1.1" 201 0
2026-03-27 12:11:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4e%252Fee%252F4eee94dccf92a4a4fd339ba028bda768%252Fpa%252FEY85081_2b9705b75a680b903004c7f63d3c76ae.jpg') HTTP/1.1" 204 0
2026-03-27 12:11:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/ee/4eee94dccf92a4a4fd339ba028bda768/pa/EY85081_2b9705b75a680b903004c7f63d3c76ae.jpg saved to cache
2026-03-27 12:11:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 608255fa-49ac-5b03-af1c-6a8855f26943
2026-03-27 12:11:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img64/93/64934bf93e30620e93ad947cb0faa26a/pa/BV58634_7d740e1a7188bcc382c0f75dd2391f6f.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:11:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252F7e%252Fc67e693a5169c3780752d681b2a56286%252Fpa%252FCT81231_205ab416f76404ea6dfd7d150a23ec66.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:11:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/7e/c67e693a5169c3780752d681b2a56286/pa/CT81231_205ab416f76404ea6dfd7d150a23ec66.jpg not downloaded yet
2026-03-27 12:11:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252F9e%252F749e896716e888d54c46ce55bdd030ee%252Fpa%252FES69537_863c43fc43c4cac813e421ede515eaa6.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:11:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/9e/749e896716e888d54c46ce55bdd030ee/pa/ES69537_863c43fc43c4cac813e421ede515eaa6.jpg not downloaded yet
2026-03-27 12:11:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg4e%252Fee%252F4eee94dccf92a4a4fd339ba028bda768%252Fpa%252FEY85081_b5cb3aa3e9526d12bd4af826983c8393.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:11:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/ee/4eee94dccf92a4a4fd339ba028bda768/pa/EY85081_b5cb3aa3e9526d12bd4af826983c8393.jpg not downloaded yet
2026-03-27 12:11:25 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 12:11:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:11:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7d007f4350>
2026-03-27 12:11:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:11:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:11:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:11:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aa8b94a4-a373-5f9e-a5de-2e5c9e5565f9/aa8b94a4-a373-5f9e-a5de-2e5c9e5565f9_image_4.jpg HTTP/1.1" 201 0
2026-03-27 12:11:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252F80%252F65805ffbc2f187043f051c911130400b%252Fpa%252FBG27703_5c2d652a5dd6d11e09e728ccbc1cace1.jpg') HTTP/1.1" 204 0
2026-03-27 12:11:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/80/65805ffbc2f187043f051c911130400b/pa/BG27703_5c2d652a5dd6d11e09e728ccbc1cace1.jpg saved to cache
2026-03-27 12:11:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item aa8b94a4-a373-5f9e-a5de-2e5c9e5565f9
2026-03-27 12:11:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:11:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7cfce6c250>
2026-03-27 12:11:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:11:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:11:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:11:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_666aa210-f426-54cd-a1d4-3adb8819bfed/666aa210-f426-54cd-a1d4-3adb8819bfed_image_5.jpg HTTP/1.1" 201 0
2026-03-27 12:11:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg41%252F58%252F4158e35b51c530a5e50603fa3ff1822a%252Fpa%252FMD45251_89d1a7f01911f44a06078857fe3fd410.jpg') HTTP/1.1" 204 0
2026-03-27 12:11:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img41/58/4158e35b51c530a5e50603fa3ff1822a/pa/MD45251_89d1a7f01911f44a06078857fe3fd410.jpg saved to cache
2026-03-27 12:11:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 666aa210-f426-54cd-a1d4-3adb8819bfed
2026-03-27 12:11:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:11:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7cfe275150>
2026-03-27 12:11:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:11:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:11:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:11:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_608255fa-49ac-5b03-af1c-6a8855f26943/608255fa-49ac-5b03-af1c-6a8855f26943_image_1.jpg HTTP/1.1" 201 0
2026-03-27 12:11:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4e%252Fee%252F4eee94dccf92a4a4fd339ba028bda768%252Fpa%252FEY85081_b05c606ac63aaa31d30ce95a122637a5.jpg') HTTP/1.1" 204 0
2026-03-27 12:11:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/ee/4eee94dccf92a4a4fd339ba028bda768/pa/EY85081_b05c606ac63aaa31d30ce95a122637a5.jpg saved to cache
2026-03-27 12:11:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 608255fa-49ac-5b03-af1c-6a8855f26943
2026-03-27 12:11:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 90dc9897-29a0-5e78-b13e-74b15d6316b1 with identifier: WY03082
2026-03-27 12:11:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 90dc9897-29a0-5e78-b13e-74b15d6316b1 with scrape type 1
2026-03-27 12:11:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 90dc9897-29a0-5e78-b13e-74b15d6316b1
2026-03-27 12:11:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252F55%252F1155ab329185f5f742716d9e3df13b1d%252Fpa%252FWY03082_805bca2ca2fc63eb4088aef290664c3e.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:11:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/55/1155ab329185f5f742716d9e3df13b1d/pa/WY03082_805bca2ca2fc63eb4088aef290664c3e.jpg already downloaded
2026-03-27 12:11:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252F55%252F1155ab329185f5f742716d9e3df13b1d%252Fpa%252FWY03082_66627943d17f0d30f88da212862447b2.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:11:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/55/1155ab329185f5f742716d9e3df13b1d/pa/WY03082_66627943d17f0d30f88da212862447b2.jpg already downloaded
2026-03-27 12:11:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252F55%252F1155ab329185f5f742716d9e3df13b1d%252Fpa%252FWY03082_a8236c1180250848cbbb88ca1867ecfe.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:11:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/55/1155ab329185f5f742716d9e3df13b1d/pa/WY03082_a8236c1180250848cbbb88ca1867ecfe.jpg already downloaded
2026-03-27 12:11:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252F55%252F1155ab329185f5f742716d9e3df13b1d%252Fpa%252FWY03082_d44758f1f899fe6bcf4e94ba5e735fc9.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:11:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/55/1155ab329185f5f742716d9e3df13b1d/pa/WY03082_d44758f1f899fe6bcf4e94ba5e735fc9.jpg already downloaded
2026-03-27 12:11:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252F55%252F1155ab329185f5f742716d9e3df13b1d%252Fpa%252FWY03082_21d63ff100a20f825437766f4997432a.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:11:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/55/1155ab329185f5f742716d9e3df13b1d/pa/WY03082_21d63ff100a20f825437766f4997432a.jpg already downloaded
2026-03-27 12:11:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252F55%252F1155ab329185f5f742716d9e3df13b1d%252Fpa%252FWY03082_448662ba70997521e3bb21d803bcf949.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:11:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/55/1155ab329185f5f742716d9e3df13b1d/pa/WY03082_448662ba70997521e3bb21d803bcf949.jpg already downloaded
2026-03-27 12:11:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252F55%252F1155ab329185f5f742716d9e3df13b1d%252Fpa%252FWY03082_17ce483446a7811997cb8a1353ff5bf7.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:11:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/55/1155ab329185f5f742716d9e3df13b1d/pa/WY03082_17ce483446a7811997cb8a1353ff5bf7.jpg already downloaded
2026-03-27 12:11:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252F55%252F1155ab329185f5f742716d9e3df13b1d%252Fpa%252FWY03082_b27f5d320baa08515d90a0e77dd30d99.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:11:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/55/1155ab329185f5f742716d9e3df13b1d/pa/WY03082_b27f5d320baa08515d90a0e77dd30d99.jpg already downloaded
2026-03-27 12:11:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252F55%252F1155ab329185f5f742716d9e3df13b1d%252Fpa%252FWY03082_35903e3514ee0ff9e76840d8c7baceff.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:11:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/55/1155ab329185f5f742716d9e3df13b1d/pa/WY03082_35903e3514ee0ff9e76840d8c7baceff.jpg already downloaded
2026-03-27 12:11:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg11%252F55%252F1155ab329185f5f742716d9e3df13b1d%252Fpa%252FWY03082_d2e9e60978f11bdea8187f415359cb2b.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:11:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img11/55/1155ab329185f5f742716d9e3df13b1d/pa/WY03082_d2e9e60978f11bdea8187f415359cb2b.jpg already downloaded
2026-03-27 12:11:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 90dc9897-29a0-5e78-b13e-74b15d6316b1, identifier: WY03082
2026-03-27 12:11:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img32/84/328439450be5ed07feb5f6037fed34e3/pa/FP18275_b766fea727b974c80ab5910e2fd35462.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:11:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img41/58/4158e35b51c530a5e50603fa3ff1822a/pa/MD45251_b56e989fc5cca3f523e6f140e0035d65.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:11:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc6/7e/c67e693a5169c3780752d681b2a56286/pa/CT81231_c29898ace457fc886696048749797a5e.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:11:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252F7e%252Fc67e693a5169c3780752d681b2a56286%252Fpa%252FCT81231_2a7f1d2705a67ba6feda179cc0ea9f08.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:11:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/7e/c67e693a5169c3780752d681b2a56286/pa/CT81231_2a7f1d2705a67ba6feda179cc0ea9f08.jpg not downloaded yet
2026-03-27 12:11:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252F9e%252F749e896716e888d54c46ce55bdd030ee%252Fpa%252FES69537_c179ef07d57582ef201c89f2b1bd6e55.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:11:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/9e/749e896716e888d54c46ce55bdd030ee/pa/ES69537_c179ef07d57582ef201c89f2b1bd6e55.jpg not downloaded yet
2026-03-27 12:11:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 90dc9897-29a0-5e78-b13e-74b15d6316b1 with identifier: WY03082
2026-03-27 12:11:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 90dc9897-29a0-5e78-b13e-74b15d6316b1 with identifier: WY03082
2026-03-27 12:11:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 90dc9897-29a0-5e78-b13e-74b15d6316b1 with identifier: WY03082 to the API
2026-03-27 12:11:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 12:11:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 12:11:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/en/app/merchant/car/WY03082>
{'auction_title': '',
 'c_o_2_emission_value': 143,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '2.0L',
 'engine_horse_power': 163,
 'expiration_date': '2026-03-28T16:02:45Z',
 'fuel_type': 'diesel',
 'id': '90dc9897-29a0-5e78-b13e-74b15d6316b1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'L949GB',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WY03082',
 'listing': 'auction',
 'location': 'NL, Venlo',
 'make': 'Opel',
 'model': 'Insignia Sports Tourer',
 'odometer': 170374,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 15,
 'photo_urls': ['https://img-pa.auto1.com/img11/55/1155ab329185f5f742716d9e3df13b1d/pa/WY03082_805bca2ca2fc63eb4088aef290664c3e.jpg',
                'https://img-pa.auto1.com/img11/55/1155ab329185f5f742716d9e3df13b1d/pa/WY03082_66627943d17f0d30f88da212862447b2.jpg',
                'https://img-pa.auto1.com/img11/55/1155ab329185f5f742716d9e3df13b1d/pa/WY03082_a8236c1180250848cbbb88ca1867ecfe.jpg',
                'https://img-pa.auto1.com/img11/55/1155ab329185f5f742716d9e3df13b1d/pa/WY03082_d44758f1f899fe6bcf4e94ba5e735fc9.jpg',
                'https://img-pa.auto1.com/img11/55/1155ab329185f5f742716d9e3df13b1d/pa/WY03082_21d63ff100a20f825437766f4997432a.jpg',
                'https://img-pa.auto1.com/img11/55/1155ab329185f5f742716d9e3df13b1d/pa/WY03082_448662ba70997521e3bb21d803bcf949.jpg',
                'https://img-pa.auto1.com/img11/55/1155ab329185f5f742716d9e3df13b1d/pa/WY03082_17ce483446a7811997cb8a1353ff5bf7.jpg',
                'https://img-pa.auto1.com/img11/55/1155ab329185f5f742716d9e3df13b1d/pa/WY03082_b27f5d320baa08515d90a0e77dd30d99.jpg',
                'https://img-pa.auto1.com/img11/55/1155ab329185f5f742716d9e3df13b1d/pa/WY03082_35903e3514ee0ff9e76840d8c7baceff.jpg',
                'https://img-pa.auto1.com/img11/55/1155ab329185f5f742716d9e3df13b1d/pa/WY03082_d2e9e60978f11bdea8187f415359cb2b.jpg'],
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_90dc9897-29a0-5e78-b13e-74b15d6316b1/90dc9897-29a0-5e78-b13e-74b15d6316b1_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 108661,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img11/55/1155ab329185f5f742716d9e3df13b1d/pa/WY03082_805bca2ca2fc63eb4088aef290664c3e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_90dc9897-29a0-5e78-b13e-74b15d6316b1/90dc9897-29a0-5e78-b13e-74b15d6316b1_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 101042,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img11/55/1155ab329185f5f742716d9e3df13b1d/pa/WY03082_66627943d17f0d30f88da212862447b2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_90dc9897-29a0-5e78-b13e-74b15d6316b1/90dc9897-29a0-5e78-b13e-74b15d6316b1_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 113466,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img11/55/1155ab329185f5f742716d9e3df13b1d/pa/WY03082_a8236c1180250848cbbb88ca1867ecfe.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_90dc9897-29a0-5e78-b13e-74b15d6316b1/90dc9897-29a0-5e78-b13e-74b15d6316b1_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80276,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img11/55/1155ab329185f5f742716d9e3df13b1d/pa/WY03082_d44758f1f899fe6bcf4e94ba5e735fc9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_90dc9897-29a0-5e78-b13e-74b15d6316b1/90dc9897-29a0-5e78-b13e-74b15d6316b1_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 99137,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img11/55/1155ab329185f5f742716d9e3df13b1d/pa/WY03082_21d63ff100a20f825437766f4997432a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_90dc9897-29a0-5e78-b13e-74b15d6316b1/90dc9897-29a0-5e78-b13e-74b15d6316b1_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 106203,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img11/55/1155ab329185f5f742716d9e3df13b1d/pa/WY03082_448662ba70997521e3bb21d803bcf949.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_90dc9897-29a0-5e78-b13e-74b15d6316b1/90dc9897-29a0-5e78-b13e-74b15d6316b1_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 83931,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img11/55/1155ab329185f5f742716d9e3df13b1d/pa/WY03082_17ce483446a7811997cb8a1353ff5bf7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_90dc9897-29a0-5e78-b13e-74b15d6316b1/90dc9897-29a0-5e78-b13e-74b15d6316b1_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 99919,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img11/55/1155ab329185f5f742716d9e3df13b1d/pa/WY03082_b27f5d320baa08515d90a0e77dd30d99.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_90dc9897-29a0-5e78-b13e-74b15d6316b1/90dc9897-29a0-5e78-b13e-74b15d6316b1_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 105891,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img11/55/1155ab329185f5f742716d9e3df13b1d/pa/WY03082_35903e3514ee0ff9e76840d8c7baceff.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_90dc9897-29a0-5e78-b13e-74b15d6316b1/90dc9897-29a0-5e78-b13e-74b15d6316b1_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 102331,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img11/55/1155ab329185f5f742716d9e3df13b1d/pa/WY03082_d2e9e60978f11bdea8187f415359cb2b.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2015-04-14',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Opel Insignia Sports Tourer 2.0 CDTI Edition',
 'transmission': 'automatic',
 'trim': 'Edition',
 'year': 2015}
2026-03-27 12:11:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WY03082%27 HTTP/1.1" 200 None
2026-03-27 12:11:26 [auto1.nl] INFO: Saving data for WY03082: {'created_time': 1774613486.038029, 'last_price_update_time': 1774613486.038042, 'auction_closing_time': 1774713765.0}
2026-03-27 12:11:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='WY03082') HTTP/1.1" 204 0
2026-03-27 12:11:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc6/7e/c67e693a5169c3780752d681b2a56286/pa/CT81231_95da80e8778d5442c3e3c3cca10809f7.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:11:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252F7e%252Fc67e693a5169c3780752d681b2a56286%252Fpa%252FCT81231_9000e2cb2d65042b8faeca845dd94e54.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:11:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/7e/c67e693a5169c3780752d681b2a56286/pa/CT81231_9000e2cb2d65042b8faeca845dd94e54.jpg not downloaded yet
2026-03-27 12:11:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252F9e%252F749e896716e888d54c46ce55bdd030ee%252Fpa%252FES69537_ff05a9ea73351ce48a11cb920efb65b9.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:11:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/9e/749e896716e888d54c46ce55bdd030ee/pa/ES69537_ff05a9ea73351ce48a11cb920efb65b9.jpg not downloaded yet
2026-03-27 12:11:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:11:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7cfe205810>
2026-03-27 12:11:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:11:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:11:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:11:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_34fb2b73-5837-529b-a0ca-24316a72a084/34fb2b73-5837-529b-a0ca-24316a72a084_image_0.jpg HTTP/1.1" 201 0
2026-03-27 12:11:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg64%252F93%252F64934bf93e30620e93ad947cb0faa26a%252Fpa%252FBV58634_7d740e1a7188bcc382c0f75dd2391f6f.jpg') HTTP/1.1" 204 0
2026-03-27 12:11:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/93/64934bf93e30620e93ad947cb0faa26a/pa/BV58634_7d740e1a7188bcc382c0f75dd2391f6f.jpg saved to cache
2026-03-27 12:11:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 34fb2b73-5837-529b-a0ca-24316a72a084
2026-03-27 12:11:26 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 12:11:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252F9e%252F749e896716e888d54c46ce55bdd030ee%252Fpa%252FES69537_8262f2ac3e48f8854a4dbec2b2ca4564.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:11:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/9e/749e896716e888d54c46ce55bdd030ee/pa/ES69537_8262f2ac3e48f8854a4dbec2b2ca4564.jpg not downloaded yet
2026-03-27 12:11:26 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 12:11:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:11:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7d007e7fd0>
2026-03-27 12:11:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:11:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:11:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:11:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_06c58ffe-f265-56ac-a40a-3ef24aa59319/06c58ffe-f265-56ac-a40a-3ef24aa59319_image_4.jpg HTTP/1.1" 201 0
2026-03-27 12:11:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg32%252F84%252F328439450be5ed07feb5f6037fed34e3%252Fpa%252FFP18275_b766fea727b974c80ab5910e2fd35462.jpg') HTTP/1.1" 204 0
2026-03-27 12:11:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img32/84/328439450be5ed07feb5f6037fed34e3/pa/FP18275_b766fea727b974c80ab5910e2fd35462.jpg saved to cache
2026-03-27 12:11:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 06c58ffe-f265-56ac-a40a-3ef24aa59319
2026-03-27 12:11:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:11:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7cfe238590>
2026-03-27 12:11:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:11:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:11:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:11:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_666aa210-f426-54cd-a1d4-3adb8819bfed/666aa210-f426-54cd-a1d4-3adb8819bfed_image_7.jpg HTTP/1.1" 201 0
2026-03-27 12:11:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg41%252F58%252F4158e35b51c530a5e50603fa3ff1822a%252Fpa%252FMD45251_b56e989fc5cca3f523e6f140e0035d65.jpg') HTTP/1.1" 204 0
2026-03-27 12:11:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img41/58/4158e35b51c530a5e50603fa3ff1822a/pa/MD45251_b56e989fc5cca3f523e6f140e0035d65.jpg saved to cache
2026-03-27 12:11:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 666aa210-f426-54cd-a1d4-3adb8819bfed
2026-03-27 12:11:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:11:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7cfdfb5290>
2026-03-27 12:11:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:11:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:11:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:11:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f2c318cb-82eb-5ef6-9ddf-86744bf6d895/f2c318cb-82eb-5ef6-9ddf-86744bf6d895_image_1.jpg HTTP/1.1" 201 0
2026-03-27 12:11:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252F7e%252Fc67e693a5169c3780752d681b2a56286%252Fpa%252FCT81231_c29898ace457fc886696048749797a5e.jpg') HTTP/1.1" 204 0
2026-03-27 12:11:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/7e/c67e693a5169c3780752d681b2a56286/pa/CT81231_c29898ace457fc886696048749797a5e.jpg saved to cache
2026-03-27 12:11:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f2c318cb-82eb-5ef6-9ddf-86744bf6d895
2026-03-27 12:11:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc6/7e/c67e693a5169c3780752d681b2a56286/pa/CT81231_2004f2a7e1f08a268334b3cfd5a995c6.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:11:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img74/9e/749e896716e888d54c46ce55bdd030ee/pa/ES69537_b155f3e7545c92734b59334e2cf8cf9f.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:11:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252F9e%252F749e896716e888d54c46ce55bdd030ee%252Fpa%252FES69537_530ac5471f2f0171ac284c49c9a46eee.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:11:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/9e/749e896716e888d54c46ce55bdd030ee/pa/ES69537_530ac5471f2f0171ac284c49c9a46eee.jpg not downloaded yet
2026-03-27 12:11:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc6/7e/c67e693a5169c3780752d681b2a56286/pa/CT81231_3e5c7569c66fe1815a03db86eb75aa92.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:11:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:11:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7cfeed4b50>
2026-03-27 12:11:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:11:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:11:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:11:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f2c318cb-82eb-5ef6-9ddf-86744bf6d895/f2c318cb-82eb-5ef6-9ddf-86744bf6d895_image_0.jpg HTTP/1.1" 201 0
2026-03-27 12:11:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252F7e%252Fc67e693a5169c3780752d681b2a56286%252Fpa%252FCT81231_95da80e8778d5442c3e3c3cca10809f7.jpg') HTTP/1.1" 204 0
2026-03-27 12:11:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/7e/c67e693a5169c3780752d681b2a56286/pa/CT81231_95da80e8778d5442c3e3c3cca10809f7.jpg saved to cache
2026-03-27 12:11:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f2c318cb-82eb-5ef6-9ddf-86744bf6d895
2026-03-27 12:11:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252F9e%252F749e896716e888d54c46ce55bdd030ee%252Fpa%252FES69537_7b3e26023969fbc7781d585de8dd619c.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:11:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/9e/749e896716e888d54c46ce55bdd030ee/pa/ES69537_7b3e26023969fbc7781d585de8dd619c.jpg not downloaded yet
2026-03-27 12:11:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc6/7e/c67e693a5169c3780752d681b2a56286/pa/CT81231_2a7f1d2705a67ba6feda179cc0ea9f08.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:11:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252F9e%252F749e896716e888d54c46ce55bdd030ee%252Fpa%252FES69537_63aa81aa3aee73b9171a81fb7bd12d5c.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:11:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/9e/749e896716e888d54c46ce55bdd030ee/pa/ES69537_63aa81aa3aee73b9171a81fb7bd12d5c.jpg not downloaded yet
2026-03-27 12:11:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img65/80/65805ffbc2f187043f051c911130400b/pa/BG27703_70aae8a624b76578606924aa6397aecd.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:11:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:11:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7cfe25cc10>
2026-03-27 12:11:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:11:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:11:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:11:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f2c318cb-82eb-5ef6-9ddf-86744bf6d895/f2c318cb-82eb-5ef6-9ddf-86744bf6d895_image_2.jpg HTTP/1.1" 201 0
2026-03-27 12:11:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252F7e%252Fc67e693a5169c3780752d681b2a56286%252Fpa%252FCT81231_2004f2a7e1f08a268334b3cfd5a995c6.jpg') HTTP/1.1" 204 0
2026-03-27 12:11:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/7e/c67e693a5169c3780752d681b2a56286/pa/CT81231_2004f2a7e1f08a268334b3cfd5a995c6.jpg saved to cache
2026-03-27 12:11:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f2c318cb-82eb-5ef6-9ddf-86744bf6d895
2026-03-27 12:11:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:11:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7cfcdaef50>
2026-03-27 12:11:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:11:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:11:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:11:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c06f76bb-78a1-59c3-8429-b24b0bd15fe7/c06f76bb-78a1-59c3-8429-b24b0bd15fe7_image_0.jpg HTTP/1.1" 201 0
2026-03-27 12:11:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252F9e%252F749e896716e888d54c46ce55bdd030ee%252Fpa%252FES69537_b155f3e7545c92734b59334e2cf8cf9f.jpg') HTTP/1.1" 204 0
2026-03-27 12:11:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/9e/749e896716e888d54c46ce55bdd030ee/pa/ES69537_b155f3e7545c92734b59334e2cf8cf9f.jpg saved to cache
2026-03-27 12:11:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c06f76bb-78a1-59c3-8429-b24b0bd15fe7
2026-03-27 12:11:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img32/84/328439450be5ed07feb5f6037fed34e3/pa/FP18275_575a707a38801dac5ff29dfb9925223c.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:11:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:11:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7cfcdae690>
2026-03-27 12:11:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:11:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:11:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:11:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f2c318cb-82eb-5ef6-9ddf-86744bf6d895/f2c318cb-82eb-5ef6-9ddf-86744bf6d895_image_4.jpg HTTP/1.1" 201 0
2026-03-27 12:11:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252F7e%252Fc67e693a5169c3780752d681b2a56286%252Fpa%252FCT81231_3e5c7569c66fe1815a03db86eb75aa92.jpg') HTTP/1.1" 204 0
2026-03-27 12:11:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/7e/c67e693a5169c3780752d681b2a56286/pa/CT81231_3e5c7569c66fe1815a03db86eb75aa92.jpg saved to cache
2026-03-27 12:11:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f2c318cb-82eb-5ef6-9ddf-86744bf6d895
2026-03-27 12:11:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:11:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7d000427d0>
2026-03-27 12:11:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:11:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:11:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:11:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f2c318cb-82eb-5ef6-9ddf-86744bf6d895/f2c318cb-82eb-5ef6-9ddf-86744bf6d895_image_8.jpg HTTP/1.1" 201 0
2026-03-27 12:11:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252F7e%252Fc67e693a5169c3780752d681b2a56286%252Fpa%252FCT81231_2a7f1d2705a67ba6feda179cc0ea9f08.jpg') HTTP/1.1" 204 0
2026-03-27 12:11:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/7e/c67e693a5169c3780752d681b2a56286/pa/CT81231_2a7f1d2705a67ba6feda179cc0ea9f08.jpg saved to cache
2026-03-27 12:11:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item f2c318cb-82eb-5ef6-9ddf-86744bf6d895
2026-03-27 12:11:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img74/9e/749e896716e888d54c46ce55bdd030ee/pa/ES69537_c179ef07d57582ef201c89f2b1bd6e55.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:11:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img74/9e/749e896716e888d54c46ce55bdd030ee/pa/ES69537_863c43fc43c4cac813e421ede515eaa6.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:11:26 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 12:11:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:11:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7cfdee5150>
2026-03-27 12:11:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:11:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:11:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:11:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aa8b94a4-a373-5f9e-a5de-2e5c9e5565f9/aa8b94a4-a373-5f9e-a5de-2e5c9e5565f9_image_7.jpg HTTP/1.1" 201 0
2026-03-27 12:11:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252F80%252F65805ffbc2f187043f051c911130400b%252Fpa%252FBG27703_70aae8a624b76578606924aa6397aecd.jpg') HTTP/1.1" 204 0
2026-03-27 12:11:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/80/65805ffbc2f187043f051c911130400b/pa/BG27703_70aae8a624b76578606924aa6397aecd.jpg saved to cache
2026-03-27 12:11:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item aa8b94a4-a373-5f9e-a5de-2e5c9e5565f9
2026-03-27 12:11:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc6/7e/c67e693a5169c3780752d681b2a56286/pa/CT81231_205ab416f76404ea6dfd7d150a23ec66.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:11:26 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 12:11:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:11:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7cfdead3d0>
2026-03-27 12:11:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:11:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:11:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:11:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_06c58ffe-f265-56ac-a40a-3ef24aa59319/06c58ffe-f265-56ac-a40a-3ef24aa59319_image_9.jpg HTTP/1.1" 201 0
2026-03-27 12:11:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg32%252F84%252F328439450be5ed07feb5f6037fed34e3%252Fpa%252FFP18275_575a707a38801dac5ff29dfb9925223c.jpg') HTTP/1.1" 204 0
2026-03-27 12:11:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img32/84/328439450be5ed07feb5f6037fed34e3/pa/FP18275_575a707a38801dac5ff29dfb9925223c.jpg saved to cache
2026-03-27 12:11:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 06c58ffe-f265-56ac-a40a-3ef24aa59319
2026-03-27 12:11:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:11:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7cfdf1c110>
2026-03-27 12:11:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:11:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:11:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:11:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c06f76bb-78a1-59c3-8429-b24b0bd15fe7/c06f76bb-78a1-59c3-8429-b24b0bd15fe7_image_4.jpg HTTP/1.1" 201 0
2026-03-27 12:11:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252F9e%252F749e896716e888d54c46ce55bdd030ee%252Fpa%252FES69537_c179ef07d57582ef201c89f2b1bd6e55.jpg') HTTP/1.1" 204 0
2026-03-27 12:11:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/9e/749e896716e888d54c46ce55bdd030ee/pa/ES69537_c179ef07d57582ef201c89f2b1bd6e55.jpg saved to cache
2026-03-27 12:11:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c06f76bb-78a1-59c3-8429-b24b0bd15fe7
2026-03-27 12:11:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:11:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7cfe053b10>
2026-03-27 12:11:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:11:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:11:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:11:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c06f76bb-78a1-59c3-8429-b24b0bd15fe7/c06f76bb-78a1-59c3-8429-b24b0bd15fe7_image_3.jpg HTTP/1.1" 201 0
2026-03-27 12:11:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252F9e%252F749e896716e888d54c46ce55bdd030ee%252Fpa%252FES69537_863c43fc43c4cac813e421ede515eaa6.jpg') HTTP/1.1" 204 0
2026-03-27 12:11:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/9e/749e896716e888d54c46ce55bdd030ee/pa/ES69537_863c43fc43c4cac813e421ede515eaa6.jpg saved to cache
2026-03-27 12:11:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c06f76bb-78a1-59c3-8429-b24b0bd15fe7
2026-03-27 12:11:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4e/ee/4eee94dccf92a4a4fd339ba028bda768/pa/EY85081_b5cb3aa3e9526d12bd4af826983c8393.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:11:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img74/9e/749e896716e888d54c46ce55bdd030ee/pa/ES69537_ff05a9ea73351ce48a11cb920efb65b9.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:11:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc6/7e/c67e693a5169c3780752d681b2a56286/pa/CT81231_45d05baa62917dfcde88f544dc4f30ba.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:11:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc6/7e/c67e693a5169c3780752d681b2a56286/pa/CT81231_9000e2cb2d65042b8faeca845dd94e54.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:11:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:11:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7cfce53a10>
2026-03-27 12:11:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:11:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:11:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:11:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f2c318cb-82eb-5ef6-9ddf-86744bf6d895/f2c318cb-82eb-5ef6-9ddf-86744bf6d895_image_7.jpg HTTP/1.1" 201 0
2026-03-27 12:11:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252F7e%252Fc67e693a5169c3780752d681b2a56286%252Fpa%252FCT81231_205ab416f76404ea6dfd7d150a23ec66.jpg') HTTP/1.1" 204 0
2026-03-27 12:11:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/7e/c67e693a5169c3780752d681b2a56286/pa/CT81231_205ab416f76404ea6dfd7d150a23ec66.jpg saved to cache
2026-03-27 12:11:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item f2c318cb-82eb-5ef6-9ddf-86744bf6d895
2026-03-27 12:11:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4e/ee/4eee94dccf92a4a4fd339ba028bda768/pa/EY85081_fbf96edd144bb310f1929539d9a0358a.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:11:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4e/ee/4eee94dccf92a4a4fd339ba028bda768/pa/EY85081_e159e8999cd72935b95e2db0ffee530c.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:11:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4e/ee/4eee94dccf92a4a4fd339ba028bda768/pa/EY85081_3ef598096dea7f54a5d2cd784cf3ee02.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:11:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:11:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7cfe05d410>
2026-03-27 12:11:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:11:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:11:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:11:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_608255fa-49ac-5b03-af1c-6a8855f26943/608255fa-49ac-5b03-af1c-6a8855f26943_image_9.jpg HTTP/1.1" 201 0
2026-03-27 12:11:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4e%252Fee%252F4eee94dccf92a4a4fd339ba028bda768%252Fpa%252FEY85081_b5cb3aa3e9526d12bd4af826983c8393.jpg') HTTP/1.1" 204 0
2026-03-27 12:11:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/ee/4eee94dccf92a4a4fd339ba028bda768/pa/EY85081_b5cb3aa3e9526d12bd4af826983c8393.jpg saved to cache
2026-03-27 12:11:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 608255fa-49ac-5b03-af1c-6a8855f26943
2026-03-27 12:11:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:11:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7cfe11ea50>
2026-03-27 12:11:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:11:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:11:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:11:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c06f76bb-78a1-59c3-8429-b24b0bd15fe7/c06f76bb-78a1-59c3-8429-b24b0bd15fe7_image_5.jpg HTTP/1.1" 201 0
2026-03-27 12:11:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252F9e%252F749e896716e888d54c46ce55bdd030ee%252Fpa%252FES69537_ff05a9ea73351ce48a11cb920efb65b9.jpg') HTTP/1.1" 204 0
2026-03-27 12:11:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/9e/749e896716e888d54c46ce55bdd030ee/pa/ES69537_ff05a9ea73351ce48a11cb920efb65b9.jpg saved to cache
2026-03-27 12:11:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c06f76bb-78a1-59c3-8429-b24b0bd15fe7
2026-03-27 12:11:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img64/93/64934bf93e30620e93ad947cb0faa26a/pa/BV58634_cdb821dcf7a169437a8f37b5a1c1df9b.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:11:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img74/9e/749e896716e888d54c46ce55bdd030ee/pa/ES69537_8262f2ac3e48f8854a4dbec2b2ca4564.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:11:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:11:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7cfdf1cc50>
2026-03-27 12:11:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:11:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:11:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:11:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f2c318cb-82eb-5ef6-9ddf-86744bf6d895/f2c318cb-82eb-5ef6-9ddf-86744bf6d895_image_6.jpg HTTP/1.1" 201 0
2026-03-27 12:11:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252F7e%252Fc67e693a5169c3780752d681b2a56286%252Fpa%252FCT81231_45d05baa62917dfcde88f544dc4f30ba.jpg') HTTP/1.1" 204 0
2026-03-27 12:11:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/7e/c67e693a5169c3780752d681b2a56286/pa/CT81231_45d05baa62917dfcde88f544dc4f30ba.jpg saved to cache
2026-03-27 12:11:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item f2c318cb-82eb-5ef6-9ddf-86744bf6d895
2026-03-27 12:11:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:11:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7cfce05850>
2026-03-27 12:11:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:11:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:11:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:11:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f2c318cb-82eb-5ef6-9ddf-86744bf6d895/f2c318cb-82eb-5ef6-9ddf-86744bf6d895_image_9.jpg HTTP/1.1" 201 0
2026-03-27 12:11:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252F7e%252Fc67e693a5169c3780752d681b2a56286%252Fpa%252FCT81231_9000e2cb2d65042b8faeca845dd94e54.jpg') HTTP/1.1" 204 0
2026-03-27 12:11:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/7e/c67e693a5169c3780752d681b2a56286/pa/CT81231_9000e2cb2d65042b8faeca845dd94e54.jpg saved to cache
2026-03-27 12:11:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item f2c318cb-82eb-5ef6-9ddf-86744bf6d895
2026-03-27 12:11:27 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 12:11:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:11:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7cfce53e90>
2026-03-27 12:11:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:11:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:11:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:11:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_608255fa-49ac-5b03-af1c-6a8855f26943/608255fa-49ac-5b03-af1c-6a8855f26943_image_2.jpg HTTP/1.1" 201 0
2026-03-27 12:11:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4e%252Fee%252F4eee94dccf92a4a4fd339ba028bda768%252Fpa%252FEY85081_fbf96edd144bb310f1929539d9a0358a.jpg') HTTP/1.1" 204 0
2026-03-27 12:11:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/ee/4eee94dccf92a4a4fd339ba028bda768/pa/EY85081_fbf96edd144bb310f1929539d9a0358a.jpg saved to cache
2026-03-27 12:11:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 608255fa-49ac-5b03-af1c-6a8855f26943
2026-03-27 12:11:27 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 12:11:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:11:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7cfce00cd0>
2026-03-27 12:11:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:11:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:11:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:11:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_608255fa-49ac-5b03-af1c-6a8855f26943/608255fa-49ac-5b03-af1c-6a8855f26943_image_3.jpg HTTP/1.1" 201 0
2026-03-27 12:11:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4e%252Fee%252F4eee94dccf92a4a4fd339ba028bda768%252Fpa%252FEY85081_e159e8999cd72935b95e2db0ffee530c.jpg') HTTP/1.1" 204 0
2026-03-27 12:11:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/ee/4eee94dccf92a4a4fd339ba028bda768/pa/EY85081_e159e8999cd72935b95e2db0ffee530c.jpg saved to cache
2026-03-27 12:11:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 608255fa-49ac-5b03-af1c-6a8855f26943
2026-03-27 12:11:27 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 12:11:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:11:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7cfdeb7a90>
2026-03-27 12:11:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:11:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:11:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:11:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_608255fa-49ac-5b03-af1c-6a8855f26943/608255fa-49ac-5b03-af1c-6a8855f26943_image_8.jpg HTTP/1.1" 201 0
2026-03-27 12:11:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4e%252Fee%252F4eee94dccf92a4a4fd339ba028bda768%252Fpa%252FEY85081_3ef598096dea7f54a5d2cd784cf3ee02.jpg') HTTP/1.1" 204 0
2026-03-27 12:11:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/ee/4eee94dccf92a4a4fd339ba028bda768/pa/EY85081_3ef598096dea7f54a5d2cd784cf3ee02.jpg saved to cache
2026-03-27 12:11:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 608255fa-49ac-5b03-af1c-6a8855f26943
2026-03-27 12:11:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img74/9e/749e896716e888d54c46ce55bdd030ee/pa/ES69537_7b3e26023969fbc7781d585de8dd619c.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:11:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img74/9e/749e896716e888d54c46ce55bdd030ee/pa/ES69537_63aa81aa3aee73b9171a81fb7bd12d5c.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:11:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc6/7e/c67e693a5169c3780752d681b2a56286/pa/CT81231_bf1add53672a07503d90891a7b5e7653.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:11:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:11:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7cfce01290>
2026-03-27 12:11:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:11:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:11:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:11:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_34fb2b73-5837-529b-a0ca-24316a72a084/34fb2b73-5837-529b-a0ca-24316a72a084_image_4.jpg HTTP/1.1" 201 0
2026-03-27 12:11:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg64%252F93%252F64934bf93e30620e93ad947cb0faa26a%252Fpa%252FBV58634_cdb821dcf7a169437a8f37b5a1c1df9b.jpg') HTTP/1.1" 204 0
2026-03-27 12:11:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/93/64934bf93e30620e93ad947cb0faa26a/pa/BV58634_cdb821dcf7a169437a8f37b5a1c1df9b.jpg saved to cache
2026-03-27 12:11:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 34fb2b73-5837-529b-a0ca-24316a72a084
2026-03-27 12:11:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:11:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7cfdfc9050>
2026-03-27 12:11:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:11:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:11:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:11:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c06f76bb-78a1-59c3-8429-b24b0bd15fe7/c06f76bb-78a1-59c3-8429-b24b0bd15fe7_image_6.jpg HTTP/1.1" 201 0
2026-03-27 12:11:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252F9e%252F749e896716e888d54c46ce55bdd030ee%252Fpa%252FES69537_8262f2ac3e48f8854a4dbec2b2ca4564.jpg') HTTP/1.1" 204 0
2026-03-27 12:11:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/9e/749e896716e888d54c46ce55bdd030ee/pa/ES69537_8262f2ac3e48f8854a4dbec2b2ca4564.jpg saved to cache
2026-03-27 12:11:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c06f76bb-78a1-59c3-8429-b24b0bd15fe7
2026-03-27 12:11:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img64/93/64934bf93e30620e93ad947cb0faa26a/pa/BV58634_7d91cc7cd2f41c7ef6cf5220d9d1d0a0.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:11:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img64/93/64934bf93e30620e93ad947cb0faa26a/pa/BV58634_a0a7d9b40bd9ed80f9d9a40986dddded.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:11:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:11:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7cfdeb5590>
2026-03-27 12:11:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:11:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:11:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:11:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c06f76bb-78a1-59c3-8429-b24b0bd15fe7/c06f76bb-78a1-59c3-8429-b24b0bd15fe7_image_8.jpg HTTP/1.1" 201 0
2026-03-27 12:11:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252F9e%252F749e896716e888d54c46ce55bdd030ee%252Fpa%252FES69537_7b3e26023969fbc7781d585de8dd619c.jpg') HTTP/1.1" 204 0
2026-03-27 12:11:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/9e/749e896716e888d54c46ce55bdd030ee/pa/ES69537_7b3e26023969fbc7781d585de8dd619c.jpg saved to cache
2026-03-27 12:11:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item c06f76bb-78a1-59c3-8429-b24b0bd15fe7
2026-03-27 12:11:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:11:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7cfdfd3610>
2026-03-27 12:11:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:11:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:11:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:11:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c06f76bb-78a1-59c3-8429-b24b0bd15fe7/c06f76bb-78a1-59c3-8429-b24b0bd15fe7_image_9.jpg HTTP/1.1" 201 0
2026-03-27 12:11:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252F9e%252F749e896716e888d54c46ce55bdd030ee%252Fpa%252FES69537_63aa81aa3aee73b9171a81fb7bd12d5c.jpg') HTTP/1.1" 204 0
2026-03-27 12:11:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/9e/749e896716e888d54c46ce55bdd030ee/pa/ES69537_63aa81aa3aee73b9171a81fb7bd12d5c.jpg saved to cache
2026-03-27 12:11:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item c06f76bb-78a1-59c3-8429-b24b0bd15fe7
2026-03-27 12:11:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img74/9e/749e896716e888d54c46ce55bdd030ee/pa/ES69537_530ac5471f2f0171ac284c49c9a46eee.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:11:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img74/9e/749e896716e888d54c46ce55bdd030ee/pa/ES69537_f6992353d592641ae1fa38b59600f26a.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:11:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:11:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7cfcde7190>
2026-03-27 12:11:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:11:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:11:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:11:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f2c318cb-82eb-5ef6-9ddf-86744bf6d895/f2c318cb-82eb-5ef6-9ddf-86744bf6d895_image_5.jpg HTTP/1.1" 201 0
2026-03-27 12:11:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252F7e%252Fc67e693a5169c3780752d681b2a56286%252Fpa%252FCT81231_bf1add53672a07503d90891a7b5e7653.jpg') HTTP/1.1" 204 0
2026-03-27 12:11:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/7e/c67e693a5169c3780752d681b2a56286/pa/CT81231_bf1add53672a07503d90891a7b5e7653.jpg saved to cache
2026-03-27 12:11:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f2c318cb-82eb-5ef6-9ddf-86744bf6d895
2026-03-27 12:11:27 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 12:11:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4e/ee/4eee94dccf92a4a4fd339ba028bda768/pa/EY85081_6b975943da60dee641b4fd8f7831360a.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:11:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.auto1.com/en/app/merchant/car/DZ87358> (referer: https://www.auto1.com/v1/car-details-view/DZ87358/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 12:11:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:11:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7cfdeb7190>
2026-03-27 12:11:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:11:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:11:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:11:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_34fb2b73-5837-529b-a0ca-24316a72a084/34fb2b73-5837-529b-a0ca-24316a72a084_image_3.jpg HTTP/1.1" 201 0
2026-03-27 12:11:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg64%252F93%252F64934bf93e30620e93ad947cb0faa26a%252Fpa%252FBV58634_7d91cc7cd2f41c7ef6cf5220d9d1d0a0.jpg') HTTP/1.1" 204 0
2026-03-27 12:11:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/93/64934bf93e30620e93ad947cb0faa26a/pa/BV58634_7d91cc7cd2f41c7ef6cf5220d9d1d0a0.jpg saved to cache
2026-03-27 12:11:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 34fb2b73-5837-529b-a0ca-24316a72a084
2026-03-27 12:11:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:11:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7cfcde5490>
2026-03-27 12:11:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:11:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:11:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:11:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_34fb2b73-5837-529b-a0ca-24316a72a084/34fb2b73-5837-529b-a0ca-24316a72a084_image_2.jpg HTTP/1.1" 201 0
2026-03-27 12:11:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg64%252F93%252F64934bf93e30620e93ad947cb0faa26a%252Fpa%252FBV58634_a0a7d9b40bd9ed80f9d9a40986dddded.jpg') HTTP/1.1" 204 0
2026-03-27 12:11:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/93/64934bf93e30620e93ad947cb0faa26a/pa/BV58634_a0a7d9b40bd9ed80f9d9a40986dddded.jpg saved to cache
2026-03-27 12:11:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 34fb2b73-5837-529b-a0ca-24316a72a084
2026-03-27 12:11:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img64/93/64934bf93e30620e93ad947cb0faa26a/pa/BV58634_3403dff4aee1d9944f1bcf3d475b0472.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:11:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4e/ee/4eee94dccf92a4a4fd339ba028bda768/pa/EY85081_cc0ebd8f7be3f73525f2c0927683aeef.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:11:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgc6/7e/c67e693a5169c3780752d681b2a56286/pa/CT81231_d4b153cefe7fa1ee96d2428b764f2a12.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:11:27 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 12:11:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:11:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7cfe0e0710>
2026-03-27 12:11:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:11:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:11:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:11:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c06f76bb-78a1-59c3-8429-b24b0bd15fe7/c06f76bb-78a1-59c3-8429-b24b0bd15fe7_image_7.jpg HTTP/1.1" 201 0
2026-03-27 12:11:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252F9e%252F749e896716e888d54c46ce55bdd030ee%252Fpa%252FES69537_530ac5471f2f0171ac284c49c9a46eee.jpg') HTTP/1.1" 204 0
2026-03-27 12:11:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/9e/749e896716e888d54c46ce55bdd030ee/pa/ES69537_530ac5471f2f0171ac284c49c9a46eee.jpg saved to cache
2026-03-27 12:11:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c06f76bb-78a1-59c3-8429-b24b0bd15fe7
2026-03-27 12:11:28 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 12:11:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:11:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7cfcd0a110>
2026-03-27 12:11:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:11:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:11:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:11:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c06f76bb-78a1-59c3-8429-b24b0bd15fe7/c06f76bb-78a1-59c3-8429-b24b0bd15fe7_image_1.jpg HTTP/1.1" 201 0
2026-03-27 12:11:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252F9e%252F749e896716e888d54c46ce55bdd030ee%252Fpa%252FES69537_f6992353d592641ae1fa38b59600f26a.jpg') HTTP/1.1" 204 0
2026-03-27 12:11:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/9e/749e896716e888d54c46ce55bdd030ee/pa/ES69537_f6992353d592641ae1fa38b59600f26a.jpg saved to cache
2026-03-27 12:11:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c06f76bb-78a1-59c3-8429-b24b0bd15fe7
2026-03-27 12:11:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img41/58/4158e35b51c530a5e50603fa3ff1822a/pa/MD45251_9338a7d6e23b725c9cb0091947666aec.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:11:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img41/58/4158e35b51c530a5e50603fa3ff1822a/pa/MD45251_252fd09681d45e75eaa4b30948c54079.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:11:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img41/58/4158e35b51c530a5e50603fa3ff1822a/pa/MD45251_b62a319d48d66234db21acbc4852d5fc.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:11:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:11:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7cfdfe0ad0>
2026-03-27 12:11:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:11:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:11:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:11:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_608255fa-49ac-5b03-af1c-6a8855f26943/608255fa-49ac-5b03-af1c-6a8855f26943_image_6.jpg HTTP/1.1" 201 0
2026-03-27 12:11:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4e%252Fee%252F4eee94dccf92a4a4fd339ba028bda768%252Fpa%252FEY85081_6b975943da60dee641b4fd8f7831360a.jpg') HTTP/1.1" 204 0
2026-03-27 12:11:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/ee/4eee94dccf92a4a4fd339ba028bda768/pa/EY85081_6b975943da60dee641b4fd8f7831360a.jpg saved to cache
2026-03-27 12:11:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 608255fa-49ac-5b03-af1c-6a8855f26943
2026-03-27 12:11:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b47c1438-9d9a-5327-a4a1-85cd6f1b2c1d with identifier: DZ87358
2026-03-27 12:11:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b47c1438-9d9a-5327-a4a1-85cd6f1b2c1d with scrape type 1
2026-03-27 12:11:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b47c1438-9d9a-5327-a4a1-85cd6f1b2c1d
2026-03-27 12:11:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252F6e%252Fad6e8af8eba6a705687e20417a1d542b%252Fpa%252FDZ87358_9bb9e4d07e98381808e8de15d34cb112.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:11:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/6e/ad6e8af8eba6a705687e20417a1d542b/pa/DZ87358_9bb9e4d07e98381808e8de15d34cb112.jpg not downloaded yet
2026-03-27 12:11:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:11:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7cfccc4410>
2026-03-27 12:11:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:11:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:11:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:11:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_34fb2b73-5837-529b-a0ca-24316a72a084/34fb2b73-5837-529b-a0ca-24316a72a084_image_1.jpg HTTP/1.1" 201 0
2026-03-27 12:11:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg64%252F93%252F64934bf93e30620e93ad947cb0faa26a%252Fpa%252FBV58634_3403dff4aee1d9944f1bcf3d475b0472.jpg') HTTP/1.1" 204 0
2026-03-27 12:11:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img64/93/64934bf93e30620e93ad947cb0faa26a/pa/BV58634_3403dff4aee1d9944f1bcf3d475b0472.jpg saved to cache
2026-03-27 12:11:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 34fb2b73-5837-529b-a0ca-24316a72a084
2026-03-27 12:11:28 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 34fb2b73-5837-529b-a0ca-24316a72a084, skipping ID generation
2026-03-27 12:11:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 34fb2b73-5837-529b-a0ca-24316a72a084 with scrape type 1
2026-03-27 12:11:28 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 34fb2b73-5837-529b-a0ca-24316a72a084 sending to next pipeline
2026-03-27 12:11:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 34fb2b73-5837-529b-a0ca-24316a72a084, identifier: BV58634
2026-03-27 12:11:28 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 12:11:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:11:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7cfe10e210>
2026-03-27 12:11:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:11:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:11:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:11:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_608255fa-49ac-5b03-af1c-6a8855f26943/608255fa-49ac-5b03-af1c-6a8855f26943_image_7.jpg HTTP/1.1" 201 0
2026-03-27 12:11:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4e%252Fee%252F4eee94dccf92a4a4fd339ba028bda768%252Fpa%252FEY85081_cc0ebd8f7be3f73525f2c0927683aeef.jpg') HTTP/1.1" 204 0
2026-03-27 12:11:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/ee/4eee94dccf92a4a4fd339ba028bda768/pa/EY85081_cc0ebd8f7be3f73525f2c0927683aeef.jpg saved to cache
2026-03-27 12:11:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 608255fa-49ac-5b03-af1c-6a8855f26943
2026-03-27 12:11:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:11:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7cfdeccd10>
2026-03-27 12:11:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:11:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:11:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:11:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f2c318cb-82eb-5ef6-9ddf-86744bf6d895/f2c318cb-82eb-5ef6-9ddf-86744bf6d895_image_3.jpg HTTP/1.1" 201 0
2026-03-27 12:11:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgc6%252F7e%252Fc67e693a5169c3780752d681b2a56286%252Fpa%252FCT81231_d4b153cefe7fa1ee96d2428b764f2a12.jpg') HTTP/1.1" 204 0
2026-03-27 12:11:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgc6/7e/c67e693a5169c3780752d681b2a56286/pa/CT81231_d4b153cefe7fa1ee96d2428b764f2a12.jpg saved to cache
2026-03-27 12:11:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f2c318cb-82eb-5ef6-9ddf-86744bf6d895
2026-03-27 12:11:28 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f2c318cb-82eb-5ef6-9ddf-86744bf6d895, skipping ID generation
2026-03-27 12:11:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f2c318cb-82eb-5ef6-9ddf-86744bf6d895 with scrape type 1
2026-03-27 12:11:28 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f2c318cb-82eb-5ef6-9ddf-86744bf6d895 sending to next pipeline
2026-03-27 12:11:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: f2c318cb-82eb-5ef6-9ddf-86744bf6d895, identifier: CT81231
2026-03-27 12:11:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 34fb2b73-5837-529b-a0ca-24316a72a084 with identifier: BV58634
2026-03-27 12:11:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 34fb2b73-5837-529b-a0ca-24316a72a084 with identifier: BV58634
2026-03-27 12:11:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 34fb2b73-5837-529b-a0ca-24316a72a084 with identifier: BV58634 to the API
2026-03-27 12:11:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 12:11:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 12:11:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img64/93/64934bf93e30620e93ad947cb0faa26a/pa/BV58634_3403dff4aee1d9944f1bcf3d475b0472.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 175,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 3',
 'engine': '1.8L',
 'engine_horse_power': 125,
 'expiration_date': '2026-03-28T16:44:42Z',
 'fuel_type': 'petrol',
 'id': '34fb2b73-5837-529b-a0ca-24316a72a084',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'GTT60T',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BV58634',
 'listing': 'auction',
 'location': 'NL, Venlo',
 'make': 'Toyota',
 'model': 'RAV 4',
 'odometer': 241773,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_34fb2b73-5837-529b-a0ca-24316a72a084/34fb2b73-5837-529b-a0ca-24316a72a084_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66052,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img64/93/64934bf93e30620e93ad947cb0faa26a/pa/BV58634_7d740e1a7188bcc382c0f75dd2391f6f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_34fb2b73-5837-529b-a0ca-24316a72a084/34fb2b73-5837-529b-a0ca-24316a72a084_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63161,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img64/93/64934bf93e30620e93ad947cb0faa26a/pa/BV58634_3403dff4aee1d9944f1bcf3d475b0472.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_34fb2b73-5837-529b-a0ca-24316a72a084/34fb2b73-5837-529b-a0ca-24316a72a084_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74100,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img64/93/64934bf93e30620e93ad947cb0faa26a/pa/BV58634_a0a7d9b40bd9ed80f9d9a40986dddded.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_34fb2b73-5837-529b-a0ca-24316a72a084/34fb2b73-5837-529b-a0ca-24316a72a084_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66901,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img64/93/64934bf93e30620e93ad947cb0faa26a/pa/BV58634_7d91cc7cd2f41c7ef6cf5220d9d1d0a0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_34fb2b73-5837-529b-a0ca-24316a72a084/34fb2b73-5837-529b-a0ca-24316a72a084_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 127755,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img64/93/64934bf93e30620e93ad947cb0faa26a/pa/BV58634_cdb821dcf7a169437a8f37b5a1c1df9b.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2001-06-06',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Toyota RAV 4 1.8',
 'transmission': 'manual',
 'trim': '',
 'year': 2001}
2026-03-27 12:11:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BV58634%27 HTTP/1.1" 200 None
2026-03-27 12:11:30 [auto1.nl] INFO: Saving data for BV58634: {'created_time': 1774613490.507858, 'last_price_update_time': 1774613490.507869, 'auction_closing_time': 1774716282.0}
2026-03-27 12:11:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='BV58634') HTTP/1.1" 204 0
2026-03-27 12:11:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: f2c318cb-82eb-5ef6-9ddf-86744bf6d895 with identifier: CT81231
2026-03-27 12:11:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: f2c318cb-82eb-5ef6-9ddf-86744bf6d895 with identifier: CT81231
2026-03-27 12:11:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: f2c318cb-82eb-5ef6-9ddf-86744bf6d895 with identifier: CT81231 to the API
2026-03-27 12:11:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 12:11:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 12:11:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgc6/7e/c67e693a5169c3780752d681b2a56286/pa/CT81231_d4b153cefe7fa1ee96d2428b764f2a12.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 102,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.0L',
 'engine_horse_power': 105,
 'expiration_date': '2026-03-28T16:58:10Z',
 'fuel_type': 'petrol',
 'id': 'f2c318cb-82eb-5ef6-9ddf-86744bf6d895',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'NR925S',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CT81231',
 'listing': 'auction',
 'location': 'NL, Groningen',
 'make': 'Opel',
 'model': 'Astra',
 'odometer': 144636,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f2c318cb-82eb-5ef6-9ddf-86744bf6d895/f2c318cb-82eb-5ef6-9ddf-86744bf6d895_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 112758,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc6/7e/c67e693a5169c3780752d681b2a56286/pa/CT81231_95da80e8778d5442c3e3c3cca10809f7.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f2c318cb-82eb-5ef6-9ddf-86744bf6d895/f2c318cb-82eb-5ef6-9ddf-86744bf6d895_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 116844,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc6/7e/c67e693a5169c3780752d681b2a56286/pa/CT81231_c29898ace457fc886696048749797a5e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f2c318cb-82eb-5ef6-9ddf-86744bf6d895/f2c318cb-82eb-5ef6-9ddf-86744bf6d895_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 113739,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc6/7e/c67e693a5169c3780752d681b2a56286/pa/CT81231_2004f2a7e1f08a268334b3cfd5a995c6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f2c318cb-82eb-5ef6-9ddf-86744bf6d895/f2c318cb-82eb-5ef6-9ddf-86744bf6d895_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 113230,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc6/7e/c67e693a5169c3780752d681b2a56286/pa/CT81231_d4b153cefe7fa1ee96d2428b764f2a12.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f2c318cb-82eb-5ef6-9ddf-86744bf6d895/f2c318cb-82eb-5ef6-9ddf-86744bf6d895_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 100821,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc6/7e/c67e693a5169c3780752d681b2a56286/pa/CT81231_3e5c7569c66fe1815a03db86eb75aa92.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f2c318cb-82eb-5ef6-9ddf-86744bf6d895/f2c318cb-82eb-5ef6-9ddf-86744bf6d895_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 113928,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc6/7e/c67e693a5169c3780752d681b2a56286/pa/CT81231_bf1add53672a07503d90891a7b5e7653.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f2c318cb-82eb-5ef6-9ddf-86744bf6d895/f2c318cb-82eb-5ef6-9ddf-86744bf6d895_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 93184,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc6/7e/c67e693a5169c3780752d681b2a56286/pa/CT81231_45d05baa62917dfcde88f544dc4f30ba.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f2c318cb-82eb-5ef6-9ddf-86744bf6d895/f2c318cb-82eb-5ef6-9ddf-86744bf6d895_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 98350,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc6/7e/c67e693a5169c3780752d681b2a56286/pa/CT81231_205ab416f76404ea6dfd7d150a23ec66.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f2c318cb-82eb-5ef6-9ddf-86744bf6d895/f2c318cb-82eb-5ef6-9ddf-86744bf6d895_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 96432,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc6/7e/c67e693a5169c3780752d681b2a56286/pa/CT81231_2a7f1d2705a67ba6feda179cc0ea9f08.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f2c318cb-82eb-5ef6-9ddf-86744bf6d895/f2c318cb-82eb-5ef6-9ddf-86744bf6d895_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 97011,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgc6/7e/c67e693a5169c3780752d681b2a56286/pa/CT81231_9000e2cb2d65042b8faeca845dd94e54.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2017-03-30',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Opel Astra 1.0 Turbo Business Start/Stop',
 'transmission': 'manual',
 'trim': 'Business Start/Stop',
 'year': 2017}
2026-03-27 12:11:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CT81231%27 HTTP/1.1" 200 None
2026-03-27 12:11:30 [auto1.nl] INFO: Saving data for CT81231: {'created_time': 1774613490.949391, 'last_price_update_time': 1774613490.949402, 'auction_closing_time': 1774717090.0}
2026-03-27 12:11:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='CT81231') HTTP/1.1" 204 0
2026-03-27 12:11:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252F6e%252Fad6e8af8eba6a705687e20417a1d542b%252Fpa%252FDZ87358_86650efde068e9d6f6833cf4eb484eb9.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:11:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/6e/ad6e8af8eba6a705687e20417a1d542b/pa/DZ87358_86650efde068e9d6f6833cf4eb484eb9.jpg not downloaded yet
2026-03-27 12:11:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img74/9e/749e896716e888d54c46ce55bdd030ee/pa/ES69537_0e4d09e779349017551011d2a1a0535c.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:11:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img06/d2/06d2dd16642358e8b7088b828e0fb47d/pa/BM13348_8558144cd693861fa1656924e3250ff3.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:11:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img06/d2/06d2dd16642358e8b7088b828e0fb47d/pa/BM13348_d6e21f50f265133eb6ec8a999b0db1d5.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:11:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img41/58/4158e35b51c530a5e50603fa3ff1822a/pa/MD45251_3219fe17adcaf2e88c2b02a6bf17d456.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:11:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img06/d2/06d2dd16642358e8b7088b828e0fb47d/pa/BM13348_789876ffcb50e420b884bdd220361aa9.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:11:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img06/d2/06d2dd16642358e8b7088b828e0fb47d/pa/BM13348_3c36f0c1f1488b18f27f21bcf69cf82c.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:11:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252F6e%252Fad6e8af8eba6a705687e20417a1d542b%252Fpa%252FDZ87358_1cbecb094189d1ee76cd8276f6d4a1e2.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:11:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/6e/ad6e8af8eba6a705687e20417a1d542b/pa/DZ87358_1cbecb094189d1ee76cd8276f6d4a1e2.jpg not downloaded yet
2026-03-27 12:11:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:11:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7cfe207a50>
2026-03-27 12:11:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:11:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:11:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:11:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_666aa210-f426-54cd-a1d4-3adb8819bfed/666aa210-f426-54cd-a1d4-3adb8819bfed_image_9.jpg HTTP/1.1" 201 0
2026-03-27 12:11:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg41%252F58%252F4158e35b51c530a5e50603fa3ff1822a%252Fpa%252FMD45251_9338a7d6e23b725c9cb0091947666aec.jpg') HTTP/1.1" 204 0
2026-03-27 12:11:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img41/58/4158e35b51c530a5e50603fa3ff1822a/pa/MD45251_9338a7d6e23b725c9cb0091947666aec.jpg saved to cache
2026-03-27 12:11:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 666aa210-f426-54cd-a1d4-3adb8819bfed
2026-03-27 12:11:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:11:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7cfe209a10>
2026-03-27 12:11:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:11:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:11:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:11:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_666aa210-f426-54cd-a1d4-3adb8819bfed/666aa210-f426-54cd-a1d4-3adb8819bfed_image_6.jpg HTTP/1.1" 201 0
2026-03-27 12:11:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg41%252F58%252F4158e35b51c530a5e50603fa3ff1822a%252Fpa%252FMD45251_252fd09681d45e75eaa4b30948c54079.jpg') HTTP/1.1" 204 0
2026-03-27 12:11:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img41/58/4158e35b51c530a5e50603fa3ff1822a/pa/MD45251_252fd09681d45e75eaa4b30948c54079.jpg saved to cache
2026-03-27 12:11:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 666aa210-f426-54cd-a1d4-3adb8819bfed
2026-03-27 12:11:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:11:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7cfcd11650>
2026-03-27 12:11:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:11:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:11:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:11:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_666aa210-f426-54cd-a1d4-3adb8819bfed/666aa210-f426-54cd-a1d4-3adb8819bfed_image_8.jpg HTTP/1.1" 201 0
2026-03-27 12:11:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg41%252F58%252F4158e35b51c530a5e50603fa3ff1822a%252Fpa%252FMD45251_b62a319d48d66234db21acbc4852d5fc.jpg') HTTP/1.1" 204 0
2026-03-27 12:11:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img41/58/4158e35b51c530a5e50603fa3ff1822a/pa/MD45251_b62a319d48d66234db21acbc4852d5fc.jpg saved to cache
2026-03-27 12:11:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 666aa210-f426-54cd-a1d4-3adb8819bfed
2026-03-27 12:11:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252F6e%252Fad6e8af8eba6a705687e20417a1d542b%252Fpa%252FDZ87358_3d1c6a73393c156c5b5578fef4719be8.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:11:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/6e/ad6e8af8eba6a705687e20417a1d542b/pa/DZ87358_3d1c6a73393c156c5b5578fef4719be8.jpg not downloaded yet
2026-03-27 12:11:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img06/d2/06d2dd16642358e8b7088b828e0fb47d/pa/BM13348_91c240ee7f2603ca67c8191c2eaba0fd.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:11:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252F6e%252Fad6e8af8eba6a705687e20417a1d542b%252Fpa%252FDZ87358_a402dcb405e7389bab507f391110216b.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:11:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/6e/ad6e8af8eba6a705687e20417a1d542b/pa/DZ87358_a402dcb405e7389bab507f391110216b.jpg not downloaded yet
2026-03-27 12:11:31 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 12:11:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:11:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7cfe11e7d0>
2026-03-27 12:11:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:11:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:11:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:11:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c06f76bb-78a1-59c3-8429-b24b0bd15fe7/c06f76bb-78a1-59c3-8429-b24b0bd15fe7_image_2.jpg HTTP/1.1" 201 0
2026-03-27 12:11:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg74%252F9e%252F749e896716e888d54c46ce55bdd030ee%252Fpa%252FES69537_0e4d09e779349017551011d2a1a0535c.jpg') HTTP/1.1" 204 0
2026-03-27 12:11:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img74/9e/749e896716e888d54c46ce55bdd030ee/pa/ES69537_0e4d09e779349017551011d2a1a0535c.jpg saved to cache
2026-03-27 12:11:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c06f76bb-78a1-59c3-8429-b24b0bd15fe7
2026-03-27 12:11:31 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c06f76bb-78a1-59c3-8429-b24b0bd15fe7, skipping ID generation
2026-03-27 12:11:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c06f76bb-78a1-59c3-8429-b24b0bd15fe7 with scrape type 1
2026-03-27 12:11:31 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c06f76bb-78a1-59c3-8429-b24b0bd15fe7 sending to next pipeline
2026-03-27 12:11:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: c06f76bb-78a1-59c3-8429-b24b0bd15fe7, identifier: ES69537
2026-03-27 12:11:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:11:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7cfe234850>
2026-03-27 12:11:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:11:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:11:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:11:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6e57e3dd-efcf-52e5-8a14-6ed566443adc/6e57e3dd-efcf-52e5-8a14-6ed566443adc_image_9.jpg HTTP/1.1" 201 0
2026-03-27 12:11:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg06%252Fd2%252F06d2dd16642358e8b7088b828e0fb47d%252Fpa%252FBM13348_8558144cd693861fa1656924e3250ff3.jpg') HTTP/1.1" 204 0
2026-03-27 12:11:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/d2/06d2dd16642358e8b7088b828e0fb47d/pa/BM13348_8558144cd693861fa1656924e3250ff3.jpg saved to cache
2026-03-27 12:11:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 6e57e3dd-efcf-52e5-8a14-6ed566443adc
2026-03-27 12:11:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:11:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7d0e84a2d0>
2026-03-27 12:11:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:11:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:11:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:11:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6e57e3dd-efcf-52e5-8a14-6ed566443adc/6e57e3dd-efcf-52e5-8a14-6ed566443adc_image_8.jpg HTTP/1.1" 201 0
2026-03-27 12:11:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg06%252Fd2%252F06d2dd16642358e8b7088b828e0fb47d%252Fpa%252FBM13348_d6e21f50f265133eb6ec8a999b0db1d5.jpg') HTTP/1.1" 204 0
2026-03-27 12:11:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/d2/06d2dd16642358e8b7088b828e0fb47d/pa/BM13348_d6e21f50f265133eb6ec8a999b0db1d5.jpg saved to cache
2026-03-27 12:11:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 6e57e3dd-efcf-52e5-8a14-6ed566443adc
2026-03-27 12:11:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:11:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7cfdf1d8d0>
2026-03-27 12:11:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:11:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:11:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:11:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_666aa210-f426-54cd-a1d4-3adb8819bfed/666aa210-f426-54cd-a1d4-3adb8819bfed_image_3.jpg HTTP/1.1" 201 0
2026-03-27 12:11:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg41%252F58%252F4158e35b51c530a5e50603fa3ff1822a%252Fpa%252FMD45251_3219fe17adcaf2e88c2b02a6bf17d456.jpg') HTTP/1.1" 204 0
2026-03-27 12:11:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img41/58/4158e35b51c530a5e50603fa3ff1822a/pa/MD45251_3219fe17adcaf2e88c2b02a6bf17d456.jpg saved to cache
2026-03-27 12:11:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 666aa210-f426-54cd-a1d4-3adb8819bfed
2026-03-27 12:11:31 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 666aa210-f426-54cd-a1d4-3adb8819bfed, skipping ID generation
2026-03-27 12:11:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 666aa210-f426-54cd-a1d4-3adb8819bfed with scrape type 1
2026-03-27 12:11:31 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 666aa210-f426-54cd-a1d4-3adb8819bfed sending to next pipeline
2026-03-27 12:11:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 666aa210-f426-54cd-a1d4-3adb8819bfed, identifier: MD45251
2026-03-27 12:11:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:11:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7cfe10eed0>
2026-03-27 12:11:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:11:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:11:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:11:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6e57e3dd-efcf-52e5-8a14-6ed566443adc/6e57e3dd-efcf-52e5-8a14-6ed566443adc_image_5.jpg HTTP/1.1" 201 0
2026-03-27 12:11:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg06%252Fd2%252F06d2dd16642358e8b7088b828e0fb47d%252Fpa%252FBM13348_789876ffcb50e420b884bdd220361aa9.jpg') HTTP/1.1" 204 0
2026-03-27 12:11:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/d2/06d2dd16642358e8b7088b828e0fb47d/pa/BM13348_789876ffcb50e420b884bdd220361aa9.jpg saved to cache
2026-03-27 12:11:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 6e57e3dd-efcf-52e5-8a14-6ed566443adc
2026-03-27 12:11:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:11:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7cfce03b90>
2026-03-27 12:11:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:11:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:11:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:11:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6e57e3dd-efcf-52e5-8a14-6ed566443adc/6e57e3dd-efcf-52e5-8a14-6ed566443adc_image_4.jpg HTTP/1.1" 201 0
2026-03-27 12:11:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg06%252Fd2%252F06d2dd16642358e8b7088b828e0fb47d%252Fpa%252FBM13348_3c36f0c1f1488b18f27f21bcf69cf82c.jpg') HTTP/1.1" 204 0
2026-03-27 12:11:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/d2/06d2dd16642358e8b7088b828e0fb47d/pa/BM13348_3c36f0c1f1488b18f27f21bcf69cf82c.jpg saved to cache
2026-03-27 12:11:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 6e57e3dd-efcf-52e5-8a14-6ed566443adc
2026-03-27 12:11:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img32/84/328439450be5ed07feb5f6037fed34e3/pa/FP18275_ecf3a8063dd8bca62ba972a1685da910.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:11:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: c06f76bb-78a1-59c3-8429-b24b0bd15fe7 with identifier: ES69537
2026-03-27 12:11:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: c06f76bb-78a1-59c3-8429-b24b0bd15fe7 with identifier: ES69537
2026-03-27 12:11:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: c06f76bb-78a1-59c3-8429-b24b0bd15fe7 with identifier: ES69537 to the API
2026-03-27 12:11:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 12:11:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 12:11:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img74/9e/749e896716e888d54c46ce55bdd030ee/pa/ES69537_0e4d09e779349017551011d2a1a0535c.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 121,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.3L',
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:31:15Z',
 'fuel_type': 'petrol',
 'id': 'c06f76bb-78a1-59c3-8429-b24b0bd15fe7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'license_plate': 'R528SL',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ES69537',
 'listing': 'auction',
 'location': 'NL, Roermond',
 'make': 'Nissan',
 'model': 'Qashqai',
 'odometer': 134147,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c06f76bb-78a1-59c3-8429-b24b0bd15fe7/c06f76bb-78a1-59c3-8429-b24b0bd15fe7_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66745,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img74/9e/749e896716e888d54c46ce55bdd030ee/pa/ES69537_b155f3e7545c92734b59334e2cf8cf9f.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c06f76bb-78a1-59c3-8429-b24b0bd15fe7/c06f76bb-78a1-59c3-8429-b24b0bd15fe7_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2093498,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img74/9e/749e896716e888d54c46ce55bdd030ee/pa/ES69537_f6992353d592641ae1fa38b59600f26a.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c06f76bb-78a1-59c3-8429-b24b0bd15fe7/c06f76bb-78a1-59c3-8429-b24b0bd15fe7_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2171510,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img74/9e/749e896716e888d54c46ce55bdd030ee/pa/ES69537_0e4d09e779349017551011d2a1a0535c.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c06f76bb-78a1-59c3-8429-b24b0bd15fe7/c06f76bb-78a1-59c3-8429-b24b0bd15fe7_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 51719,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img74/9e/749e896716e888d54c46ce55bdd030ee/pa/ES69537_863c43fc43c4cac813e421ede515eaa6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c06f76bb-78a1-59c3-8429-b24b0bd15fe7/c06f76bb-78a1-59c3-8429-b24b0bd15fe7_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 66667,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img74/9e/749e896716e888d54c46ce55bdd030ee/pa/ES69537_c179ef07d57582ef201c89f2b1bd6e55.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c06f76bb-78a1-59c3-8429-b24b0bd15fe7/c06f76bb-78a1-59c3-8429-b24b0bd15fe7_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64605,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img74/9e/749e896716e888d54c46ce55bdd030ee/pa/ES69537_ff05a9ea73351ce48a11cb920efb65b9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c06f76bb-78a1-59c3-8429-b24b0bd15fe7/c06f76bb-78a1-59c3-8429-b24b0bd15fe7_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 53313,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img74/9e/749e896716e888d54c46ce55bdd030ee/pa/ES69537_8262f2ac3e48f8854a4dbec2b2ca4564.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c06f76bb-78a1-59c3-8429-b24b0bd15fe7/c06f76bb-78a1-59c3-8429-b24b0bd15fe7_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2245764,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img74/9e/749e896716e888d54c46ce55bdd030ee/pa/ES69537_530ac5471f2f0171ac284c49c9a46eee.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c06f76bb-78a1-59c3-8429-b24b0bd15fe7/c06f76bb-78a1-59c3-8429-b24b0bd15fe7_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69359,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img74/9e/749e896716e888d54c46ce55bdd030ee/pa/ES69537_7b3e26023969fbc7781d585de8dd619c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c06f76bb-78a1-59c3-8429-b24b0bd15fe7/c06f76bb-78a1-59c3-8429-b24b0bd15fe7_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57872,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img74/9e/749e896716e888d54c46ce55bdd030ee/pa/ES69537_63aa81aa3aee73b9171a81fb7bd12d5c.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2019-09-09',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Nissan Qashqai 1.3 DIG-T Acenta',
 'transmission': 'manual',
 'trim': 'Acenta',
 'year': 2019}
2026-03-27 12:11:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ES69537%27 HTTP/1.1" 200 None
2026-03-27 12:11:32 [auto1.nl] INFO: Saving data for ES69537: {'created_time': 1774613492.143398, 'last_price_update_time': 1774613492.143409, 'auction_closing_time': 1774715475.0}
2026-03-27 12:11:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='ES69537') HTTP/1.1" 204 0
2026-03-27 12:11:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 666aa210-f426-54cd-a1d4-3adb8819bfed with identifier: MD45251
2026-03-27 12:11:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 666aa210-f426-54cd-a1d4-3adb8819bfed with identifier: MD45251
2026-03-27 12:11:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 666aa210-f426-54cd-a1d4-3adb8819bfed with identifier: MD45251 to the API
2026-03-27 12:11:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 12:11:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 12:11:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img41/58/4158e35b51c530a5e50603fa3ff1822a/pa/MD45251_3219fe17adcaf2e88c2b02a6bf17d456.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 129,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.8L',
 'engine_horse_power': 180,
 'expiration_date': '2026-03-28T16:13:36Z',
 'fuel_type': 'petrol',
 'id': '666aa210-f426-54cd-a1d4-3adb8819bfed',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'HB298S',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MD45251',
 'listing': 'auction',
 'location': 'NL, Arnhem',
 'make': 'Seat',
 'model': 'Leon',
 'odometer': 114858,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_666aa210-f426-54cd-a1d4-3adb8819bfed/666aa210-f426-54cd-a1d4-3adb8819bfed_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 113305,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img41/58/4158e35b51c530a5e50603fa3ff1822a/pa/MD45251_4bb3c9af338cd71eb06c85b7488a6099.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_666aa210-f426-54cd-a1d4-3adb8819bfed/666aa210-f426-54cd-a1d4-3adb8819bfed_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 97790,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img41/58/4158e35b51c530a5e50603fa3ff1822a/pa/MD45251_941ef2a455767a8b4f9eb9e7812d0ef6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_666aa210-f426-54cd-a1d4-3adb8819bfed/666aa210-f426-54cd-a1d4-3adb8819bfed_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 116008,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img41/58/4158e35b51c530a5e50603fa3ff1822a/pa/MD45251_27451980f7dbde12fe3364e801e816d6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_666aa210-f426-54cd-a1d4-3adb8819bfed/666aa210-f426-54cd-a1d4-3adb8819bfed_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 92595,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img41/58/4158e35b51c530a5e50603fa3ff1822a/pa/MD45251_3219fe17adcaf2e88c2b02a6bf17d456.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_666aa210-f426-54cd-a1d4-3adb8819bfed/666aa210-f426-54cd-a1d4-3adb8819bfed_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 101899,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img41/58/4158e35b51c530a5e50603fa3ff1822a/pa/MD45251_672aacf52a0de78c17433fc342944b1c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_666aa210-f426-54cd-a1d4-3adb8819bfed/666aa210-f426-54cd-a1d4-3adb8819bfed_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 116444,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img41/58/4158e35b51c530a5e50603fa3ff1822a/pa/MD45251_89d1a7f01911f44a06078857fe3fd410.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_666aa210-f426-54cd-a1d4-3adb8819bfed/666aa210-f426-54cd-a1d4-3adb8819bfed_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 99373,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img41/58/4158e35b51c530a5e50603fa3ff1822a/pa/MD45251_252fd09681d45e75eaa4b30948c54079.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_666aa210-f426-54cd-a1d4-3adb8819bfed/666aa210-f426-54cd-a1d4-3adb8819bfed_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 100970,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img41/58/4158e35b51c530a5e50603fa3ff1822a/pa/MD45251_b56e989fc5cca3f523e6f140e0035d65.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_666aa210-f426-54cd-a1d4-3adb8819bfed/666aa210-f426-54cd-a1d4-3adb8819bfed_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 108054,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img41/58/4158e35b51c530a5e50603fa3ff1822a/pa/MD45251_b62a319d48d66234db21acbc4852d5fc.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_666aa210-f426-54cd-a1d4-3adb8819bfed/666aa210-f426-54cd-a1d4-3adb8819bfed_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 104187,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img41/58/4158e35b51c530a5e50603fa3ff1822a/pa/MD45251_9338a7d6e23b725c9cb0091947666aec.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2015-09-30',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Seat Leon 1.8 TSI FR',
 'transmission': 'automatic',
 'trim': 'FR',
 'year': 2015}
2026-03-27 12:11:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MD45251%27 HTTP/1.1" 200 None
2026-03-27 12:11:32 [auto1.nl] INFO: Saving data for MD45251: {'created_time': 1774613492.552532, 'last_price_update_time': 1774613492.552543, 'auction_closing_time': 1774714416.0}
2026-03-27 12:11:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='MD45251') HTTP/1.1" 204 0
2026-03-27 12:11:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img65/80/65805ffbc2f187043f051c911130400b/pa/BG27703_80b2654f17b38553d53e3306f553a473.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:11:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252F6e%252Fad6e8af8eba6a705687e20417a1d542b%252Fpa%252FDZ87358_604cc18ec0db46f6a5dcc083ad4e8ea8.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:11:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/6e/ad6e8af8eba6a705687e20417a1d542b/pa/DZ87358_604cc18ec0db46f6a5dcc083ad4e8ea8.jpg not downloaded yet
2026-03-27 12:11:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img65/80/65805ffbc2f187043f051c911130400b/pa/BG27703_141359cf0934d4dc9763c142a660674c.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:11:32 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 12:11:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252F6e%252Fad6e8af8eba6a705687e20417a1d542b%252Fpa%252FDZ87358_bcba7294466a2ced4079e5ec7d4cb9a3.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:11:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/6e/ad6e8af8eba6a705687e20417a1d542b/pa/DZ87358_bcba7294466a2ced4079e5ec7d4cb9a3.jpg not downloaded yet
2026-03-27 12:11:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:11:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7d0018a1d0>
2026-03-27 12:11:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:11:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:11:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:11:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6e57e3dd-efcf-52e5-8a14-6ed566443adc/6e57e3dd-efcf-52e5-8a14-6ed566443adc_image_1.jpg HTTP/1.1" 201 0
2026-03-27 12:11:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg06%252Fd2%252F06d2dd16642358e8b7088b828e0fb47d%252Fpa%252FBM13348_91c240ee7f2603ca67c8191c2eaba0fd.jpg') HTTP/1.1" 204 0
2026-03-27 12:11:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img06/d2/06d2dd16642358e8b7088b828e0fb47d/pa/BM13348_91c240ee7f2603ca67c8191c2eaba0fd.jpg saved to cache
2026-03-27 12:11:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 6e57e3dd-efcf-52e5-8a14-6ed566443adc
2026-03-27 12:11:32 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6e57e3dd-efcf-52e5-8a14-6ed566443adc, skipping ID generation
2026-03-27 12:11:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6e57e3dd-efcf-52e5-8a14-6ed566443adc with scrape type 1
2026-03-27 12:11:32 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6e57e3dd-efcf-52e5-8a14-6ed566443adc sending to next pipeline
2026-03-27 12:11:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 6e57e3dd-efcf-52e5-8a14-6ed566443adc, identifier: BM13348
2026-03-27 12:11:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:11:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7cfdf0a390>
2026-03-27 12:11:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:11:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:11:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:11:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_06c58ffe-f265-56ac-a40a-3ef24aa59319/06c58ffe-f265-56ac-a40a-3ef24aa59319_image_8.jpg HTTP/1.1" 201 0
2026-03-27 12:11:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg32%252F84%252F328439450be5ed07feb5f6037fed34e3%252Fpa%252FFP18275_ecf3a8063dd8bca62ba972a1685da910.jpg') HTTP/1.1" 204 0
2026-03-27 12:11:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img32/84/328439450be5ed07feb5f6037fed34e3/pa/FP18275_ecf3a8063dd8bca62ba972a1685da910.jpg saved to cache
2026-03-27 12:11:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 06c58ffe-f265-56ac-a40a-3ef24aa59319
2026-03-27 12:11:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252F6e%252Fad6e8af8eba6a705687e20417a1d542b%252Fpa%252FDZ87358_52852438e1fd90770d24231382fe1626.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:11:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/6e/ad6e8af8eba6a705687e20417a1d542b/pa/DZ87358_52852438e1fd90770d24231382fe1626.jpg not downloaded yet
2026-03-27 12:11:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 6e57e3dd-efcf-52e5-8a14-6ed566443adc with identifier: BM13348
2026-03-27 12:11:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 6e57e3dd-efcf-52e5-8a14-6ed566443adc with identifier: BM13348
2026-03-27 12:11:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 6e57e3dd-efcf-52e5-8a14-6ed566443adc with identifier: BM13348 to the API
2026-03-27 12:11:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 12:11:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 12:11:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img06/d2/06d2dd16642358e8b7088b828e0fb47d/pa/BM13348_91c240ee7f2603ca67c8191c2eaba0fd.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 105,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.6L',
 'engine_horse_power': 120,
 'expiration_date': '2026-03-28T16:17:45Z',
 'fuel_type': 'diesel',
 'id': '6e57e3dd-efcf-52e5-8a14-6ed566443adc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'KP106S',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BM13348',
 'listing': 'auction',
 'location': 'NL, Roermond',
 'make': 'Skoda',
 'model': 'Superb',
 'odometer': 257552,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6e57e3dd-efcf-52e5-8a14-6ed566443adc/6e57e3dd-efcf-52e5-8a14-6ed566443adc_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69122,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img06/d2/06d2dd16642358e8b7088b828e0fb47d/pa/BM13348_98574d23e9a1b261c0781eeef5fabf7c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6e57e3dd-efcf-52e5-8a14-6ed566443adc/6e57e3dd-efcf-52e5-8a14-6ed566443adc_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65759,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img06/d2/06d2dd16642358e8b7088b828e0fb47d/pa/BM13348_91c240ee7f2603ca67c8191c2eaba0fd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6e57e3dd-efcf-52e5-8a14-6ed566443adc/6e57e3dd-efcf-52e5-8a14-6ed566443adc_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68734,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img06/d2/06d2dd16642358e8b7088b828e0fb47d/pa/BM13348_42be10a9145da5c016d53a93e95965c3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6e57e3dd-efcf-52e5-8a14-6ed566443adc/6e57e3dd-efcf-52e5-8a14-6ed566443adc_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 60037,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img06/d2/06d2dd16642358e8b7088b828e0fb47d/pa/BM13348_f3ceb46d4cb559026a144362c79dafe2.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6e57e3dd-efcf-52e5-8a14-6ed566443adc/6e57e3dd-efcf-52e5-8a14-6ed566443adc_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67529,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img06/d2/06d2dd16642358e8b7088b828e0fb47d/pa/BM13348_3c36f0c1f1488b18f27f21bcf69cf82c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6e57e3dd-efcf-52e5-8a14-6ed566443adc/6e57e3dd-efcf-52e5-8a14-6ed566443adc_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65780,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img06/d2/06d2dd16642358e8b7088b828e0fb47d/pa/BM13348_789876ffcb50e420b884bdd220361aa9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6e57e3dd-efcf-52e5-8a14-6ed566443adc/6e57e3dd-efcf-52e5-8a14-6ed566443adc_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65592,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img06/d2/06d2dd16642358e8b7088b828e0fb47d/pa/BM13348_6911ef15a51560b5e384d59de03b9373.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6e57e3dd-efcf-52e5-8a14-6ed566443adc/6e57e3dd-efcf-52e5-8a14-6ed566443adc_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74609,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img06/d2/06d2dd16642358e8b7088b828e0fb47d/pa/BM13348_93b459e748700b16f22d74c639e9dc86.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6e57e3dd-efcf-52e5-8a14-6ed566443adc/6e57e3dd-efcf-52e5-8a14-6ed566443adc_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74010,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img06/d2/06d2dd16642358e8b7088b828e0fb47d/pa/BM13348_d6e21f50f265133eb6ec8a999b0db1d5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6e57e3dd-efcf-52e5-8a14-6ed566443adc/6e57e3dd-efcf-52e5-8a14-6ed566443adc_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79848,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img06/d2/06d2dd16642358e8b7088b828e0fb47d/pa/BM13348_8558144cd693861fa1656924e3250ff3.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2016-11-10',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Skoda Superb 1.6 TDI Ambition',
 'transmission': 'manual',
 'trim': 'Ambition',
 'year': 2016}
2026-03-27 12:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BM13348%27 HTTP/1.1" 200 None
2026-03-27 12:11:33 [auto1.nl] INFO: Saving data for BM13348: {'created_time': 1774613493.204614, 'last_price_update_time': 1774613493.204626, 'auction_closing_time': 1774714665.0}
2026-03-27 12:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='BM13348') HTTP/1.1" 204 0
2026-03-27 12:11:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgad/6e/ad6e8af8eba6a705687e20417a1d542b/pa/DZ87358_9bb9e4d07e98381808e8de15d34cb112.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:11:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img65/80/65805ffbc2f187043f051c911130400b/pa/BG27703_8b8bca5f4c8e00d0af1f787a703af872.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252F6e%252Fad6e8af8eba6a705687e20417a1d542b%252Fpa%252FDZ87358_178839568a7535ae001b3f3be8f06e98.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:11:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/6e/ad6e8af8eba6a705687e20417a1d542b/pa/DZ87358_178839568a7535ae001b3f3be8f06e98.jpg not downloaded yet
2026-03-27 12:11:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:11:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7d00295d50>
2026-03-27 12:11:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:11:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:11:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:11:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aa8b94a4-a373-5f9e-a5de-2e5c9e5565f9/aa8b94a4-a373-5f9e-a5de-2e5c9e5565f9_image_6.jpg HTTP/1.1" 201 0
2026-03-27 12:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252F80%252F65805ffbc2f187043f051c911130400b%252Fpa%252FBG27703_80b2654f17b38553d53e3306f553a473.jpg') HTTP/1.1" 204 0
2026-03-27 12:11:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/80/65805ffbc2f187043f051c911130400b/pa/BG27703_80b2654f17b38553d53e3306f553a473.jpg saved to cache
2026-03-27 12:11:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item aa8b94a4-a373-5f9e-a5de-2e5c9e5565f9
2026-03-27 12:11:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:11:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7cfdfaae10>
2026-03-27 12:11:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:11:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:11:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:11:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aa8b94a4-a373-5f9e-a5de-2e5c9e5565f9/aa8b94a4-a373-5f9e-a5de-2e5c9e5565f9_image_5.jpg HTTP/1.1" 201 0
2026-03-27 12:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252F80%252F65805ffbc2f187043f051c911130400b%252Fpa%252FBG27703_141359cf0934d4dc9763c142a660674c.jpg') HTTP/1.1" 204 0
2026-03-27 12:11:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/80/65805ffbc2f187043f051c911130400b/pa/BG27703_141359cf0934d4dc9763c142a660674c.jpg saved to cache
2026-03-27 12:11:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item aa8b94a4-a373-5f9e-a5de-2e5c9e5565f9
2026-03-27 12:11:33 [auto1.nl] INFO: Channel: 24h | Page: 8 | totalHits: 1060 | hits on page: 40
2026-03-27 12:11:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img32/84/328439450be5ed07feb5f6037fed34e3/pa/FP18275_9e2ac84aeb4ad7f35003c21173b81af6.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252F6e%252Fad6e8af8eba6a705687e20417a1d542b%252Fpa%252FDZ87358_aec884f588e96bb06b59b45fba35ba55.jpg%27 HTTP/1.1" 200 None
2026-03-27 12:11:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/6e/ad6e8af8eba6a705687e20417a1d542b/pa/DZ87358_aec884f588e96bb06b59b45fba35ba55.jpg not downloaded yet
2026-03-27 12:11:33 [auto1.nl] INFO: Found listing with ID: PV96248
2026-03-27 12:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PV96248%27 HTTP/1.1" 200 None
2026-03-27 12:11:33 [auto1.nl] INFO: Scrape type for PV96248: 0
2026-03-27 12:11:33 [auto1.nl] INFO: Found listing with ID: ZT03654
2026-03-27 12:11:33 [auto1.nl] INFO: Found listing with ID: EZ41839
2026-03-27 12:11:33 [auto1.nl] INFO: Found listing with ID: GT27619
2026-03-27 12:11:33 [auto1.nl] INFO: Found listing with ID: CR08212
2026-03-27 12:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CR08212%27 HTTP/1.1" 200 None
2026-03-27 12:11:33 [auto1.nl] INFO: Scrape type for CR08212: 0
2026-03-27 12:11:33 [auto1.nl] INFO: Found listing with ID: PJ49676
2026-03-27 12:11:33 [auto1.nl] INFO: Found listing with ID: MC16226
2026-03-27 12:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MC16226%27 HTTP/1.1" 200 None
2026-03-27 12:11:33 [auto1.nl] INFO: Scrape type for MC16226: 0
2026-03-27 12:11:33 [auto1.nl] INFO: Found listing with ID: PK22988
2026-03-27 12:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PK22988%27 HTTP/1.1" 200 None
2026-03-27 12:11:33 [auto1.nl] INFO: Scrape type for PK22988: 0
2026-03-27 12:11:33 [auto1.nl] INFO: Found listing with ID: FA22053
2026-03-27 12:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FA22053%27 HTTP/1.1" 200 None
2026-03-27 12:11:33 [auto1.nl] INFO: Scrape type for FA22053: 0
2026-03-27 12:11:33 [auto1.nl] INFO: Found listing with ID: BF79856
2026-03-27 12:11:33 [auto1.nl] INFO: Found listing with ID: DA17330
2026-03-27 12:11:33 [auto1.nl] INFO: Found listing with ID: CN01691
2026-03-27 12:11:33 [auto1.nl] INFO: Found listing with ID: PF97973
2026-03-27 12:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PF97973%27 HTTP/1.1" 200 None
2026-03-27 12:11:33 [auto1.nl] INFO: Scrape type for PF97973: 0
2026-03-27 12:11:33 [auto1.nl] INFO: Found listing with ID: DS12857
2026-03-27 12:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DS12857%27 HTTP/1.1" 200 None
2026-03-27 12:11:33 [auto1.nl] INFO: Scrape type for DS12857: 0
2026-03-27 12:11:33 [auto1.nl] INFO: Found listing with ID: RM20026
2026-03-27 12:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RM20026%27 HTTP/1.1" 200 None
2026-03-27 12:11:33 [auto1.nl] INFO: Scrape type for RM20026: 0
2026-03-27 12:11:33 [auto1.nl] INFO: Found listing with ID: JA63213
2026-03-27 12:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JA63213%27 HTTP/1.1" 200 None
2026-03-27 12:11:33 [auto1.nl] INFO: Scrape type for JA63213: 0
2026-03-27 12:11:33 [auto1.nl] INFO: Found listing with ID: XX17303
2026-03-27 12:11:33 [auto1.nl] INFO: Found listing with ID: MA10228
2026-03-27 12:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MA10228%27 HTTP/1.1" 200 None
2026-03-27 12:11:33 [auto1.nl] INFO: Scrape type for MA10228: 0
2026-03-27 12:11:33 [auto1.nl] INFO: Found listing with ID: NT73578
2026-03-27 12:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NT73578%27 HTTP/1.1" 200 None
2026-03-27 12:11:33 [auto1.nl] INFO: Scrape type for NT73578: 0
2026-03-27 12:11:33 [auto1.nl] INFO: Found listing with ID: GC72456
2026-03-27 12:11:33 [auto1.nl] INFO: Found listing with ID: AK38952
2026-03-27 12:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AK38952%27 HTTP/1.1" 200 None
2026-03-27 12:11:33 [auto1.nl] INFO: Scrape type for AK38952: 0
2026-03-27 12:11:33 [auto1.nl] INFO: Found listing with ID: GW12777
2026-03-27 12:11:33 [auto1.nl] INFO: Found listing with ID: XS82099
2026-03-27 12:11:33 [auto1.nl] INFO: Found listing with ID: AS79214
2026-03-27 12:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AS79214%27 HTTP/1.1" 200 None
2026-03-27 12:11:33 [auto1.nl] INFO: Scrape type for AS79214: 0
2026-03-27 12:11:33 [auto1.nl] INFO: Found listing with ID: VB20382
2026-03-27 12:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VB20382%27 HTTP/1.1" 200 None
2026-03-27 12:11:33 [auto1.nl] INFO: Scrape type for VB20382: 0
2026-03-27 12:11:33 [auto1.nl] INFO: Found listing with ID: SA24792
2026-03-27 12:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SA24792%27 HTTP/1.1" 200 None
2026-03-27 12:11:33 [auto1.nl] INFO: Scrape type for SA24792: 0
2026-03-27 12:11:33 [auto1.nl] INFO: Found listing with ID: HL15145
2026-03-27 12:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HL15145%27 HTTP/1.1" 200 None
2026-03-27 12:11:33 [auto1.nl] INFO: Scrape type for HL15145: 0
2026-03-27 12:11:33 [auto1.nl] INFO: Found listing with ID: NM22595
2026-03-27 12:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NM22595%27 HTTP/1.1" 200 None
2026-03-27 12:11:33 [auto1.nl] INFO: Scrape type for NM22595: 0
2026-03-27 12:11:33 [auto1.nl] INFO: Found listing with ID: BL56682
2026-03-27 12:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BL56682%27 HTTP/1.1" 200 None
2026-03-27 12:11:33 [auto1.nl] INFO: Scrape type for BL56682: 0
2026-03-27 12:11:33 [auto1.nl] INFO: Found listing with ID: PN74472
2026-03-27 12:11:33 [auto1.nl] INFO: Found listing with ID: HR81591
2026-03-27 12:11:33 [auto1.nl] INFO: Found listing with ID: LH74130
2026-03-27 12:11:33 [auto1.nl] INFO: Found listing with ID: CH03360
2026-03-27 12:11:33 [auto1.nl] INFO: Found listing with ID: PH10928
2026-03-27 12:11:33 [auto1.nl] INFO: Found listing with ID: AV65488
2026-03-27 12:11:33 [auto1.nl] INFO: Found listing with ID: NN10776
2026-03-27 12:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NN10776%27 HTTP/1.1" 200 None
2026-03-27 12:11:33 [auto1.nl] INFO: Scrape type for NN10776: 0
2026-03-27 12:11:33 [auto1.nl] INFO: Found listing with ID: ED59845
2026-03-27 12:11:33 [auto1.nl] INFO: Found listing with ID: BC68713
2026-03-27 12:11:33 [auto1.nl] INFO: Found listing with ID: KJ58786
2026-03-27 12:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KJ58786%27 HTTP/1.1" 200 None
2026-03-27 12:11:33 [auto1.nl] INFO: Scrape type for KJ58786: 0
2026-03-27 12:11:33 [auto1.nl] INFO: Found listing with ID: BK15232
2026-03-27 12:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BK15232%27 HTTP/1.1" 200 None
2026-03-27 12:11:33 [auto1.nl] INFO: Scrape type for BK15232: 0
2026-03-27 12:11:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 12:11:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img65/80/65805ffbc2f187043f051c911130400b/pa/BG27703_5078dd48ccf77bacef6abec0883e4e19.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:11:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgad/6e/ad6e8af8eba6a705687e20417a1d542b/pa/DZ87358_86650efde068e9d6f6833cf4eb484eb9.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:11:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:11:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7cfce43bd0>
2026-03-27 12:11:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:11:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:11:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:11:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b47c1438-9d9a-5327-a4a1-85cd6f1b2c1d/b47c1438-9d9a-5327-a4a1-85cd6f1b2c1d_image_0.jpg HTTP/1.1" 201 0
2026-03-27 12:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252F6e%252Fad6e8af8eba6a705687e20417a1d542b%252Fpa%252FDZ87358_9bb9e4d07e98381808e8de15d34cb112.jpg') HTTP/1.1" 204 0
2026-03-27 12:11:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/6e/ad6e8af8eba6a705687e20417a1d542b/pa/DZ87358_9bb9e4d07e98381808e8de15d34cb112.jpg saved to cache
2026-03-27 12:11:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b47c1438-9d9a-5327-a4a1-85cd6f1b2c1d
2026-03-27 12:11:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:11:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7cfe06cfd0>
2026-03-27 12:11:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:11:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:11:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:11:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aa8b94a4-a373-5f9e-a5de-2e5c9e5565f9/aa8b94a4-a373-5f9e-a5de-2e5c9e5565f9_image_3.jpg HTTP/1.1" 201 0
2026-03-27 12:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252F80%252F65805ffbc2f187043f051c911130400b%252Fpa%252FBG27703_8b8bca5f4c8e00d0af1f787a703af872.jpg') HTTP/1.1" 204 0
2026-03-27 12:11:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/80/65805ffbc2f187043f051c911130400b/pa/BG27703_8b8bca5f4c8e00d0af1f787a703af872.jpg saved to cache
2026-03-27 12:11:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item aa8b94a4-a373-5f9e-a5de-2e5c9e5565f9
2026-03-27 12:11:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:11:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7cfccfc910>
2026-03-27 12:11:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:11:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:11:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:11:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_06c58ffe-f265-56ac-a40a-3ef24aa59319/06c58ffe-f265-56ac-a40a-3ef24aa59319_image_5.jpg HTTP/1.1" 201 0
2026-03-27 12:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg32%252F84%252F328439450be5ed07feb5f6037fed34e3%252Fpa%252FFP18275_9e2ac84aeb4ad7f35003c21173b81af6.jpg') HTTP/1.1" 204 0
2026-03-27 12:11:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img32/84/328439450be5ed07feb5f6037fed34e3/pa/FP18275_9e2ac84aeb4ad7f35003c21173b81af6.jpg saved to cache
2026-03-27 12:11:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 06c58ffe-f265-56ac-a40a-3ef24aa59319
2026-03-27 12:11:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:11:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7cfcdc59d0>
2026-03-27 12:11:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:11:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:11:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:11:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aa8b94a4-a373-5f9e-a5de-2e5c9e5565f9/aa8b94a4-a373-5f9e-a5de-2e5c9e5565f9_image_1.jpg HTTP/1.1" 201 0
2026-03-27 12:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252F80%252F65805ffbc2f187043f051c911130400b%252Fpa%252FBG27703_5078dd48ccf77bacef6abec0883e4e19.jpg') HTTP/1.1" 204 0
2026-03-27 12:11:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/80/65805ffbc2f187043f051c911130400b/pa/BG27703_5078dd48ccf77bacef6abec0883e4e19.jpg saved to cache
2026-03-27 12:11:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item aa8b94a4-a373-5f9e-a5de-2e5c9e5565f9
2026-03-27 12:11:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:11:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7cfccf7890>
2026-03-27 12:11:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:11:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:11:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:11:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b47c1438-9d9a-5327-a4a1-85cd6f1b2c1d/b47c1438-9d9a-5327-a4a1-85cd6f1b2c1d_image_1.jpg HTTP/1.1" 201 0
2026-03-27 12:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252F6e%252Fad6e8af8eba6a705687e20417a1d542b%252Fpa%252FDZ87358_86650efde068e9d6f6833cf4eb484eb9.jpg') HTTP/1.1" 204 0
2026-03-27 12:11:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/6e/ad6e8af8eba6a705687e20417a1d542b/pa/DZ87358_86650efde068e9d6f6833cf4eb484eb9.jpg saved to cache
2026-03-27 12:11:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b47c1438-9d9a-5327-a4a1-85cd6f1b2c1d
2026-03-27 12:11:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4e/ee/4eee94dccf92a4a4fd339ba028bda768/pa/EY85081_6da110733f706b50fa3c27544558bd5b.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:11:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img32/84/328439450be5ed07feb5f6037fed34e3/pa/FP18275_e21f0567b8e3660faf939e110f1c1c39.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:11:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img4e/ee/4eee94dccf92a4a4fd339ba028bda768/pa/EY85081_04e410b586cebb18aaa5fb0a7614c6a0.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:11:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img65/80/65805ffbc2f187043f051c911130400b/pa/BG27703_fbe0035e0bbde9820bea1b830d915aca.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:11:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img32/84/328439450be5ed07feb5f6037fed34e3/pa/FP18275_02b4429b1af9b7d784cab7a51920407e.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:11:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img32/84/328439450be5ed07feb5f6037fed34e3/pa/FP18275_8328901bcddcefe81dbfe57a52b06b1e.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:11:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img65/80/65805ffbc2f187043f051c911130400b/pa/BG27703_c881b58ac7fdb63cdf8153dcb9711c3b.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:11:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgad/6e/ad6e8af8eba6a705687e20417a1d542b/pa/DZ87358_a402dcb405e7389bab507f391110216b.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:11:34 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 12:11:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:11:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7d0dc67910>
2026-03-27 12:11:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:11:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:11:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:11:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_608255fa-49ac-5b03-af1c-6a8855f26943/608255fa-49ac-5b03-af1c-6a8855f26943_image_5.jpg HTTP/1.1" 201 0
2026-03-27 12:11:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4e%252Fee%252F4eee94dccf92a4a4fd339ba028bda768%252Fpa%252FEY85081_6da110733f706b50fa3c27544558bd5b.jpg') HTTP/1.1" 204 0
2026-03-27 12:11:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/ee/4eee94dccf92a4a4fd339ba028bda768/pa/EY85081_6da110733f706b50fa3c27544558bd5b.jpg saved to cache
2026-03-27 12:11:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 608255fa-49ac-5b03-af1c-6a8855f26943
2026-03-27 12:11:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgad/6e/ad6e8af8eba6a705687e20417a1d542b/pa/DZ87358_3d1c6a73393c156c5b5578fef4719be8.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:11:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgad/6e/ad6e8af8eba6a705687e20417a1d542b/pa/DZ87358_178839568a7535ae001b3f3be8f06e98.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:11:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img32/84/328439450be5ed07feb5f6037fed34e3/pa/FP18275_8c0cae720c93fe207ef616a0ed3d07f3.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:11:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgde/b3/deb31bb4df775e323a3cf705e5b6ccbb/pa/SW07946_591cfe6cf6af80939d614beee7deb219.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:11:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:11:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7cfcdee910>
2026-03-27 12:11:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:11:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:11:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:11:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_06c58ffe-f265-56ac-a40a-3ef24aa59319/06c58ffe-f265-56ac-a40a-3ef24aa59319_image_2.jpg HTTP/1.1" 201 0
2026-03-27 12:11:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg32%252F84%252F328439450be5ed07feb5f6037fed34e3%252Fpa%252FFP18275_e21f0567b8e3660faf939e110f1c1c39.jpg') HTTP/1.1" 204 0
2026-03-27 12:11:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img32/84/328439450be5ed07feb5f6037fed34e3/pa/FP18275_e21f0567b8e3660faf939e110f1c1c39.jpg saved to cache
2026-03-27 12:11:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 06c58ffe-f265-56ac-a40a-3ef24aa59319
2026-03-27 12:11:34 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 12:11:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:11:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7cfdeafd50>
2026-03-27 12:11:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:11:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:11:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:11:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_608255fa-49ac-5b03-af1c-6a8855f26943/608255fa-49ac-5b03-af1c-6a8855f26943_image_4.jpg HTTP/1.1" 201 0
2026-03-27 12:11:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg4e%252Fee%252F4eee94dccf92a4a4fd339ba028bda768%252Fpa%252FEY85081_04e410b586cebb18aaa5fb0a7614c6a0.jpg') HTTP/1.1" 204 0
2026-03-27 12:11:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img4e/ee/4eee94dccf92a4a4fd339ba028bda768/pa/EY85081_04e410b586cebb18aaa5fb0a7614c6a0.jpg saved to cache
2026-03-27 12:11:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 608255fa-49ac-5b03-af1c-6a8855f26943
2026-03-27 12:11:34 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 608255fa-49ac-5b03-af1c-6a8855f26943, skipping ID generation
2026-03-27 12:11:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 608255fa-49ac-5b03-af1c-6a8855f26943 with scrape type 1
2026-03-27 12:11:34 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 608255fa-49ac-5b03-af1c-6a8855f26943 sending to next pipeline
2026-03-27 12:11:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 608255fa-49ac-5b03-af1c-6a8855f26943, identifier: EY85081
2026-03-27 12:11:34 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 12:11:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:11:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7cfe016450>
2026-03-27 12:11:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:11:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:11:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:11:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aa8b94a4-a373-5f9e-a5de-2e5c9e5565f9/aa8b94a4-a373-5f9e-a5de-2e5c9e5565f9_image_9.jpg HTTP/1.1" 201 0
2026-03-27 12:11:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252F80%252F65805ffbc2f187043f051c911130400b%252Fpa%252FBG27703_fbe0035e0bbde9820bea1b830d915aca.jpg') HTTP/1.1" 204 0
2026-03-27 12:11:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/80/65805ffbc2f187043f051c911130400b/pa/BG27703_fbe0035e0bbde9820bea1b830d915aca.jpg saved to cache
2026-03-27 12:11:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item aa8b94a4-a373-5f9e-a5de-2e5c9e5565f9
2026-03-27 12:11:34 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 12:11:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:11:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7cfccdf190>
2026-03-27 12:11:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:11:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:11:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:11:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_06c58ffe-f265-56ac-a40a-3ef24aa59319/06c58ffe-f265-56ac-a40a-3ef24aa59319_image_7.jpg HTTP/1.1" 201 0
2026-03-27 12:11:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg32%252F84%252F328439450be5ed07feb5f6037fed34e3%252Fpa%252FFP18275_02b4429b1af9b7d784cab7a51920407e.jpg') HTTP/1.1" 204 0
2026-03-27 12:11:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img32/84/328439450be5ed07feb5f6037fed34e3/pa/FP18275_02b4429b1af9b7d784cab7a51920407e.jpg saved to cache
2026-03-27 12:11:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 06c58ffe-f265-56ac-a40a-3ef24aa59319
2026-03-27 12:11:34 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 12:11:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:11:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7d0001c310>
2026-03-27 12:11:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:11:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:11:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:11:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_06c58ffe-f265-56ac-a40a-3ef24aa59319/06c58ffe-f265-56ac-a40a-3ef24aa59319_image_6.jpg HTTP/1.1" 201 0
2026-03-27 12:11:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg32%252F84%252F328439450be5ed07feb5f6037fed34e3%252Fpa%252FFP18275_8328901bcddcefe81dbfe57a52b06b1e.jpg') HTTP/1.1" 204 0
2026-03-27 12:11:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img32/84/328439450be5ed07feb5f6037fed34e3/pa/FP18275_8328901bcddcefe81dbfe57a52b06b1e.jpg saved to cache
2026-03-27 12:11:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 06c58ffe-f265-56ac-a40a-3ef24aa59319
2026-03-27 12:11:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:11:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7cfcdee210>
2026-03-27 12:11:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:11:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:11:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:11:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aa8b94a4-a373-5f9e-a5de-2e5c9e5565f9/aa8b94a4-a373-5f9e-a5de-2e5c9e5565f9_image_0.jpg HTTP/1.1" 201 0
2026-03-27 12:11:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg65%252F80%252F65805ffbc2f187043f051c911130400b%252Fpa%252FBG27703_c881b58ac7fdb63cdf8153dcb9711c3b.jpg') HTTP/1.1" 204 0
2026-03-27 12:11:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img65/80/65805ffbc2f187043f051c911130400b/pa/BG27703_c881b58ac7fdb63cdf8153dcb9711c3b.jpg saved to cache
2026-03-27 12:11:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item aa8b94a4-a373-5f9e-a5de-2e5c9e5565f9
2026-03-27 12:11:35 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: aa8b94a4-a373-5f9e-a5de-2e5c9e5565f9, skipping ID generation
2026-03-27 12:11:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item aa8b94a4-a373-5f9e-a5de-2e5c9e5565f9 with scrape type 1
2026-03-27 12:11:35 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item aa8b94a4-a373-5f9e-a5de-2e5c9e5565f9 sending to next pipeline
2026-03-27 12:11:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: aa8b94a4-a373-5f9e-a5de-2e5c9e5565f9, identifier: BG27703
2026-03-27 12:11:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:11:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7cfe0a1fd0>
2026-03-27 12:11:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:11:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:11:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:11:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b47c1438-9d9a-5327-a4a1-85cd6f1b2c1d/b47c1438-9d9a-5327-a4a1-85cd6f1b2c1d_image_4.jpg HTTP/1.1" 201 0
2026-03-27 12:11:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252F6e%252Fad6e8af8eba6a705687e20417a1d542b%252Fpa%252FDZ87358_a402dcb405e7389bab507f391110216b.jpg') HTTP/1.1" 204 0
2026-03-27 12:11:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/6e/ad6e8af8eba6a705687e20417a1d542b/pa/DZ87358_a402dcb405e7389bab507f391110216b.jpg saved to cache
2026-03-27 12:11:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b47c1438-9d9a-5327-a4a1-85cd6f1b2c1d
2026-03-27 12:11:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 608255fa-49ac-5b03-af1c-6a8855f26943 with identifier: EY85081
2026-03-27 12:11:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 608255fa-49ac-5b03-af1c-6a8855f26943 with identifier: EY85081
2026-03-27 12:11:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 608255fa-49ac-5b03-af1c-6a8855f26943 with identifier: EY85081 to the API
2026-03-27 12:11:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 12:11:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 12:11:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img4e/ee/4eee94dccf92a4a4fd339ba028bda768/pa/EY85081_04e410b586cebb18aaa5fb0a7614c6a0.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '1.2L',
 'engine_horse_power': 115,
 'expiration_date': '2026-03-28T16:45:37Z',
 'fuel_type': 'petrol',
 'id': '608255fa-49ac-5b03-af1c-6a8855f26943',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'X-408-TR',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EY85081',
 'listing': 'auction',
 'location': 'Tradein',
 'make': 'Nissan',
 'model': 'Qashqai',
 'odometer': 132697,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_608255fa-49ac-5b03-af1c-6a8855f26943/608255fa-49ac-5b03-af1c-6a8855f26943_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 71668,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4e/ee/4eee94dccf92a4a4fd339ba028bda768/pa/EY85081_2b9705b75a680b903004c7f63d3c76ae.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_608255fa-49ac-5b03-af1c-6a8855f26943/608255fa-49ac-5b03-af1c-6a8855f26943_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65871,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4e/ee/4eee94dccf92a4a4fd339ba028bda768/pa/EY85081_b05c606ac63aaa31d30ce95a122637a5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_608255fa-49ac-5b03-af1c-6a8855f26943/608255fa-49ac-5b03-af1c-6a8855f26943_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2629381,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img4e/ee/4eee94dccf92a4a4fd339ba028bda768/pa/EY85081_fbf96edd144bb310f1929539d9a0358a.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_608255fa-49ac-5b03-af1c-6a8855f26943/608255fa-49ac-5b03-af1c-6a8855f26943_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2562340,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img4e/ee/4eee94dccf92a4a4fd339ba028bda768/pa/EY85081_e159e8999cd72935b95e2db0ffee530c.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_608255fa-49ac-5b03-af1c-6a8855f26943/608255fa-49ac-5b03-af1c-6a8855f26943_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2750655,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img4e/ee/4eee94dccf92a4a4fd339ba028bda768/pa/EY85081_04e410b586cebb18aaa5fb0a7614c6a0.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_608255fa-49ac-5b03-af1c-6a8855f26943/608255fa-49ac-5b03-af1c-6a8855f26943_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2660805,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img4e/ee/4eee94dccf92a4a4fd339ba028bda768/pa/EY85081_6da110733f706b50fa3c27544558bd5b.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_608255fa-49ac-5b03-af1c-6a8855f26943/608255fa-49ac-5b03-af1c-6a8855f26943_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 50727,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4e/ee/4eee94dccf92a4a4fd339ba028bda768/pa/EY85081_6b975943da60dee641b4fd8f7831360a.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_608255fa-49ac-5b03-af1c-6a8855f26943/608255fa-49ac-5b03-af1c-6a8855f26943_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2522854,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img4e/ee/4eee94dccf92a4a4fd339ba028bda768/pa/EY85081_cc0ebd8f7be3f73525f2c0927683aeef.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_608255fa-49ac-5b03-af1c-6a8855f26943/608255fa-49ac-5b03-af1c-6a8855f26943_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2527869,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img4e/ee/4eee94dccf92a4a4fd339ba028bda768/pa/EY85081_3ef598096dea7f54a5d2cd784cf3ee02.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_608255fa-49ac-5b03-af1c-6a8855f26943/608255fa-49ac-5b03-af1c-6a8855f26943_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 58269,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img4e/ee/4eee94dccf92a4a4fd339ba028bda768/pa/EY85081_b5cb3aa3e9526d12bd4af826983c8393.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2018-08-15',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Nissan Qashqai 1.2 N-Connecta',
 'transmission': 'manual',
 'trim': 'N-Connecta',
 'year': 2018}
2026-03-27 12:11:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EY85081%27 HTTP/1.1" 200 None
2026-03-27 12:11:35 [auto1.nl] INFO: Saving data for EY85081: {'created_time': 1774613495.617623, 'last_price_update_time': 1774613495.617637, 'auction_closing_time': 1774716337.0}
2026-03-27 12:11:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='EY85081') HTTP/1.1" 204 0
2026-03-27 12:11:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: aa8b94a4-a373-5f9e-a5de-2e5c9e5565f9 with identifier: BG27703
2026-03-27 12:11:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: aa8b94a4-a373-5f9e-a5de-2e5c9e5565f9 with identifier: BG27703
2026-03-27 12:11:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: aa8b94a4-a373-5f9e-a5de-2e5c9e5565f9 with identifier: BG27703 to the API
2026-03-27 12:11:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 12:11:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 12:11:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img65/80/65805ffbc2f187043f051c911130400b/pa/BG27703_c881b58ac7fdb63cdf8153dcb9711c3b.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 164,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'emission_standard': 'EURO 5',
 'engine': '2.0L',
 'engine_horse_power': 140,
 'expiration_date': '2026-03-28T16:07:52Z',
 'fuel_type': 'diesel',
 'id': 'aa8b94a4-a373-5f9e-a5de-2e5c9e5565f9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'VG361F',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BG27703',
 'listing': 'auction',
 'location': 'NL, Eindhoven',
 'make': 'Volkswagen',
 'model': 'Caddy',
 'odometer': 350023,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aa8b94a4-a373-5f9e-a5de-2e5c9e5565f9/aa8b94a4-a373-5f9e-a5de-2e5c9e5565f9_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 81877,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img65/80/65805ffbc2f187043f051c911130400b/pa/BG27703_c881b58ac7fdb63cdf8153dcb9711c3b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aa8b94a4-a373-5f9e-a5de-2e5c9e5565f9/aa8b94a4-a373-5f9e-a5de-2e5c9e5565f9_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 82304,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img65/80/65805ffbc2f187043f051c911130400b/pa/BG27703_5078dd48ccf77bacef6abec0883e4e19.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aa8b94a4-a373-5f9e-a5de-2e5c9e5565f9/aa8b94a4-a373-5f9e-a5de-2e5c9e5565f9_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2438272,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img65/80/65805ffbc2f187043f051c911130400b/pa/BG27703_6e735c0b82e259746020c82b8940b660.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aa8b94a4-a373-5f9e-a5de-2e5c9e5565f9/aa8b94a4-a373-5f9e-a5de-2e5c9e5565f9_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 79501,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img65/80/65805ffbc2f187043f051c911130400b/pa/BG27703_8b8bca5f4c8e00d0af1f787a703af872.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aa8b94a4-a373-5f9e-a5de-2e5c9e5565f9/aa8b94a4-a373-5f9e-a5de-2e5c9e5565f9_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2283979,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img65/80/65805ffbc2f187043f051c911130400b/pa/BG27703_5c2d652a5dd6d11e09e728ccbc1cace1.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aa8b94a4-a373-5f9e-a5de-2e5c9e5565f9/aa8b94a4-a373-5f9e-a5de-2e5c9e5565f9_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 68693,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img65/80/65805ffbc2f187043f051c911130400b/pa/BG27703_141359cf0934d4dc9763c142a660674c.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aa8b94a4-a373-5f9e-a5de-2e5c9e5565f9/aa8b94a4-a373-5f9e-a5de-2e5c9e5565f9_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62137,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img65/80/65805ffbc2f187043f051c911130400b/pa/BG27703_80b2654f17b38553d53e3306f553a473.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aa8b94a4-a373-5f9e-a5de-2e5c9e5565f9/aa8b94a4-a373-5f9e-a5de-2e5c9e5565f9_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2679501,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img65/80/65805ffbc2f187043f051c911130400b/pa/BG27703_70aae8a624b76578606924aa6397aecd.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aa8b94a4-a373-5f9e-a5de-2e5c9e5565f9/aa8b94a4-a373-5f9e-a5de-2e5c9e5565f9_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 75389,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img65/80/65805ffbc2f187043f051c911130400b/pa/BG27703_b23872d03e5bc583630f59759a944ec6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aa8b94a4-a373-5f9e-a5de-2e5c9e5565f9/aa8b94a4-a373-5f9e-a5de-2e5c9e5565f9_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2586392,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img65/80/65805ffbc2f187043f051c911130400b/pa/BG27703_fbe0035e0bbde9820bea1b830d915aca.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2013-11-13',
 'seats_number': 2,
 'seller_name': None,
 'title': 'Volkswagen Caddy 2.0 TDI Kasten',
 'transmission': 'automatic',
 'trim': 'Kasten',
 'year': 2013}
2026-03-27 12:11:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BG27703%27 HTTP/1.1" 200 None
2026-03-27 12:11:36 [auto1.nl] INFO: Saving data for BG27703: {'created_time': 1774613496.083068, 'last_price_update_time': 1774613496.083079, 'auction_closing_time': 1774714072.0}
2026-03-27 12:11:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='BG27703') HTTP/1.1" 204 0
2026-03-27 12:11:36 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 12:11:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:11:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7cfcde4dd0>
2026-03-27 12:11:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:11:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:11:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:11:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b47c1438-9d9a-5327-a4a1-85cd6f1b2c1d/b47c1438-9d9a-5327-a4a1-85cd6f1b2c1d_image_3.jpg HTTP/1.1" 201 0
2026-03-27 12:11:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252F6e%252Fad6e8af8eba6a705687e20417a1d542b%252Fpa%252FDZ87358_3d1c6a73393c156c5b5578fef4719be8.jpg') HTTP/1.1" 204 0
2026-03-27 12:11:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/6e/ad6e8af8eba6a705687e20417a1d542b/pa/DZ87358_3d1c6a73393c156c5b5578fef4719be8.jpg saved to cache
2026-03-27 12:11:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b47c1438-9d9a-5327-a4a1-85cd6f1b2c1d
2026-03-27 12:11:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:11:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7cfeed5450>
2026-03-27 12:11:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:11:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:11:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:11:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b47c1438-9d9a-5327-a4a1-85cd6f1b2c1d/b47c1438-9d9a-5327-a4a1-85cd6f1b2c1d_image_8.jpg HTTP/1.1" 201 0
2026-03-27 12:11:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252F6e%252Fad6e8af8eba6a705687e20417a1d542b%252Fpa%252FDZ87358_178839568a7535ae001b3f3be8f06e98.jpg') HTTP/1.1" 204 0
2026-03-27 12:11:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/6e/ad6e8af8eba6a705687e20417a1d542b/pa/DZ87358_178839568a7535ae001b3f3be8f06e98.jpg saved to cache
2026-03-27 12:11:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item b47c1438-9d9a-5327-a4a1-85cd6f1b2c1d
2026-03-27 12:11:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:11:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7cfe0f96d0>
2026-03-27 12:11:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:11:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:11:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:11:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_06c58ffe-f265-56ac-a40a-3ef24aa59319/06c58ffe-f265-56ac-a40a-3ef24aa59319_image_1.jpg HTTP/1.1" 201 0
2026-03-27 12:11:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg32%252F84%252F328439450be5ed07feb5f6037fed34e3%252Fpa%252FFP18275_8c0cae720c93fe207ef616a0ed3d07f3.jpg') HTTP/1.1" 204 0
2026-03-27 12:11:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img32/84/328439450be5ed07feb5f6037fed34e3/pa/FP18275_8c0cae720c93fe207ef616a0ed3d07f3.jpg saved to cache
2026-03-27 12:11:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 06c58ffe-f265-56ac-a40a-3ef24aa59319
2026-03-27 12:11:36 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 06c58ffe-f265-56ac-a40a-3ef24aa59319, skipping ID generation
2026-03-27 12:11:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 06c58ffe-f265-56ac-a40a-3ef24aa59319 with scrape type 1
2026-03-27 12:11:36 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 06c58ffe-f265-56ac-a40a-3ef24aa59319 sending to next pipeline
2026-03-27 12:11:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 06c58ffe-f265-56ac-a40a-3ef24aa59319, identifier: FP18275
2026-03-27 12:11:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:11:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7cfdf021d0>
2026-03-27 12:11:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:11:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:11:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:11:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4d36e696-242f-50bd-b51a-cb662ac69482/4d36e696-242f-50bd-b51a-cb662ac69482_image_0.jpg HTTP/1.1" 201 0
2026-03-27 12:11:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgde%252Fb3%252Fdeb31bb4df775e323a3cf705e5b6ccbb%252Fpa%252FSW07946_591cfe6cf6af80939d614beee7deb219.jpg') HTTP/1.1" 204 0
2026-03-27 12:11:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgde/b3/deb31bb4df775e323a3cf705e5b6ccbb/pa/SW07946_591cfe6cf6af80939d614beee7deb219.jpg saved to cache
2026-03-27 12:11:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4d36e696-242f-50bd-b51a-cb662ac69482
2026-03-27 12:11:36 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4d36e696-242f-50bd-b51a-cb662ac69482, skipping ID generation
2026-03-27 12:11:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4d36e696-242f-50bd-b51a-cb662ac69482 with scrape type 1
2026-03-27 12:11:36 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4d36e696-242f-50bd-b51a-cb662ac69482 sending to next pipeline
2026-03-27 12:11:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 4d36e696-242f-50bd-b51a-cb662ac69482, identifier: SW07946
2026-03-27 12:11:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 06c58ffe-f265-56ac-a40a-3ef24aa59319 with identifier: FP18275
2026-03-27 12:11:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 06c58ffe-f265-56ac-a40a-3ef24aa59319 with identifier: FP18275
2026-03-27 12:11:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 06c58ffe-f265-56ac-a40a-3ef24aa59319 with identifier: FP18275 to the API
2026-03-27 12:11:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 12:11:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 12:11:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img32/84/328439450be5ed07feb5f6037fed34e3/pa/FP18275_8c0cae720c93fe207ef616a0ed3d07f3.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 112,
 'category': None,
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 6',
 'engine': '2.0L',
 'engine_horse_power': 150,
 'expiration_date': '2026-03-28T16:44:47Z',
 'fuel_type': 'diesel',
 'id': '06c58ffe-f265-56ac-a40a-3ef24aa59319',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'N615KP',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FP18275',
 'listing': 'auction',
 'location': 'NL, Enschede',
 'make': 'BMW',
 'model': '3er',
 'odometer': 295232,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 14,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_06c58ffe-f265-56ac-a40a-3ef24aa59319/06c58ffe-f265-56ac-a40a-3ef24aa59319_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73374,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img32/84/328439450be5ed07feb5f6037fed34e3/pa/FP18275_6e873ee57fe11183cf2e0dcf40b0d024.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_06c58ffe-f265-56ac-a40a-3ef24aa59319/06c58ffe-f265-56ac-a40a-3ef24aa59319_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78747,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img32/84/328439450be5ed07feb5f6037fed34e3/pa/FP18275_8c0cae720c93fe207ef616a0ed3d07f3.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_06c58ffe-f265-56ac-a40a-3ef24aa59319/06c58ffe-f265-56ac-a40a-3ef24aa59319_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69230,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img32/84/328439450be5ed07feb5f6037fed34e3/pa/FP18275_e21f0567b8e3660faf939e110f1c1c39.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_06c58ffe-f265-56ac-a40a-3ef24aa59319/06c58ffe-f265-56ac-a40a-3ef24aa59319_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 74147,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img32/84/328439450be5ed07feb5f6037fed34e3/pa/FP18275_a313a978df61076d6691aad5f9d10cac.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_06c58ffe-f265-56ac-a40a-3ef24aa59319/06c58ffe-f265-56ac-a40a-3ef24aa59319_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2793645,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img32/84/328439450be5ed07feb5f6037fed34e3/pa/FP18275_b766fea727b974c80ab5910e2fd35462.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_06c58ffe-f265-56ac-a40a-3ef24aa59319/06c58ffe-f265-56ac-a40a-3ef24aa59319_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 76775,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img32/84/328439450be5ed07feb5f6037fed34e3/pa/FP18275_9e2ac84aeb4ad7f35003c21173b81af6.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_06c58ffe-f265-56ac-a40a-3ef24aa59319/06c58ffe-f265-56ac-a40a-3ef24aa59319_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2932688,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img32/84/328439450be5ed07feb5f6037fed34e3/pa/FP18275_8328901bcddcefe81dbfe57a52b06b1e.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_06c58ffe-f265-56ac-a40a-3ef24aa59319/06c58ffe-f265-56ac-a40a-3ef24aa59319_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 3065569,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img32/84/328439450be5ed07feb5f6037fed34e3/pa/FP18275_02b4429b1af9b7d784cab7a51920407e.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_06c58ffe-f265-56ac-a40a-3ef24aa59319/06c58ffe-f265-56ac-a40a-3ef24aa59319_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 77448,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img32/84/328439450be5ed07feb5f6037fed34e3/pa/FP18275_ecf3a8063dd8bca62ba972a1685da910.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_06c58ffe-f265-56ac-a40a-3ef24aa59319/06c58ffe-f265-56ac-a40a-3ef24aa59319_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2988371,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/img32/84/328439450be5ed07feb5f6037fed34e3/pa/FP18275_575a707a38801dac5ff29dfb9925223c.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2016-03-02',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 3er 318d Advantage',
 'transmission': 'manual',
 'trim': 'Advantage',
 'year': 2016}
2026-03-27 12:11:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FP18275%27 HTTP/1.1" 200 None
2026-03-27 12:11:36 [auto1.nl] INFO: Saving data for FP18275: {'created_time': 1774613496.826994, 'last_price_update_time': 1774613496.827007, 'auction_closing_time': 1774716287.0}
2026-03-27 12:11:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='FP18275') HTTP/1.1" 204 0
2026-03-27 12:11:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 4d36e696-242f-50bd-b51a-cb662ac69482 with identifier: SW07946
2026-03-27 12:11:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 4d36e696-242f-50bd-b51a-cb662ac69482 with identifier: SW07946
2026-03-27 12:11:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 4d36e696-242f-50bd-b51a-cb662ac69482 with identifier: SW07946 to the API
2026-03-27 12:11:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 12:11:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 12:11:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgde/b3/deb31bb4df775e323a3cf705e5b6ccbb/pa/SW07946_591cfe6cf6af80939d614beee7deb219.jpg>
{'auction_title': '',
 'c_o_2_emission_value': 148,
 'category': None,
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 4',
 'engine': '1.3L',
 'engine_horse_power': 92,
 'expiration_date': '2026-03-28T16:57:44Z',
 'fuel_type': 'petrol',
 'id': '4d36e696-242f-50bd-b51a-cb662ac69482',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': '34TLTD',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SW07946',
 'listing': 'auction',
 'location': 'NL, Venlo',
 'make': 'Suzuki',
 'model': 'Swift',
 'odometer': 212267,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4d36e696-242f-50bd-b51a-cb662ac69482/4d36e696-242f-50bd-b51a-cb662ac69482_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 64524,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgde/b3/deb31bb4df775e323a3cf705e5b6ccbb/pa/SW07946_591cfe6cf6af80939d614beee7deb219.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4d36e696-242f-50bd-b51a-cb662ac69482/4d36e696-242f-50bd-b51a-cb662ac69482_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78472,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgde/b3/deb31bb4df775e323a3cf705e5b6ccbb/pa/SW07946_cb6830a1e118b198d7df457bd1c4b846.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4d36e696-242f-50bd-b51a-cb662ac69482/4d36e696-242f-50bd-b51a-cb662ac69482_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 80071,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgde/b3/deb31bb4df775e323a3cf705e5b6ccbb/pa/SW07946_e4af824320963862fea2e99773b3643e.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4d36e696-242f-50bd-b51a-cb662ac69482/4d36e696-242f-50bd-b51a-cb662ac69482_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 63379,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgde/b3/deb31bb4df775e323a3cf705e5b6ccbb/pa/SW07946_e80b2677434e0de876c91ed8a36a80bd.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4d36e696-242f-50bd-b51a-cb662ac69482/4d36e696-242f-50bd-b51a-cb662ac69482_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 107517,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgde/b3/deb31bb4df775e323a3cf705e5b6ccbb/pa/SW07946_21a210b1f3768a277495829ab062742f.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2006-11-15',
 'seats_number': 5,
 'seller_name': None,
 'title': 'Suzuki Swift 1.3 Club',
 'transmission': 'manual',
 'trim': 'Club',
 'year': 2006}
2026-03-27 12:11:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SW07946%27 HTTP/1.1" 200 None
2026-03-27 12:11:37 [auto1.nl] INFO: Saving data for SW07946: {'created_time': 1774613497.222004, 'last_price_update_time': 1774613497.222015, 'auction_closing_time': 1774717064.0}
2026-03-27 12:11:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='SW07946') HTTP/1.1" 204 0
2026-03-27 12:11:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img88/b9/88b92cdb4c8063993bcba71c3252525f/pa/FR68688_345b87a1fb1aaaa2b27584bd925544a0.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:11:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/img88/b9/88b92cdb4c8063993bcba71c3252525f/pa/FR68688_cbfd8add973ff71b5c791446074e6c33.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:11:37 [auto1.nl] INFO: Channel: 24h | Page: 9 | totalHits: 1060 | hits on page: 40
2026-03-27 12:11:37 [auto1.nl] INFO: Found listing with ID: NL54745
2026-03-27 12:11:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NL54745%27 HTTP/1.1" 200 None
2026-03-27 12:11:37 [auto1.nl] INFO: Scrape type for NL54745: 0
2026-03-27 12:11:37 [auto1.nl] INFO: Found listing with ID: SB79167
2026-03-27 12:11:37 [auto1.nl] INFO: Found listing with ID: HU61188
2026-03-27 12:11:37 [auto1.nl] INFO: Found listing with ID: GT38548
2026-03-27 12:11:37 [auto1.nl] INFO: Found listing with ID: MC36011
2026-03-27 12:11:37 [auto1.nl] INFO: Found listing with ID: JN62257
2026-03-27 12:11:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JN62257%27 HTTP/1.1" 200 None
2026-03-27 12:11:37 [auto1.nl] INFO: Scrape type for JN62257: 0
2026-03-27 12:11:37 [auto1.nl] INFO: Found listing with ID: ZM40656
2026-03-27 12:11:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZM40656%27 HTTP/1.1" 200 None
2026-03-27 12:11:37 [auto1.nl] INFO: Scrape type for ZM40656: 0
2026-03-27 12:11:37 [auto1.nl] INFO: Found listing with ID: AU66208
2026-03-27 12:11:37 [auto1.nl] INFO: Found listing with ID: DD20442
2026-03-27 12:11:37 [auto1.nl] INFO: Found listing with ID: AM12843
2026-03-27 12:11:37 [auto1.nl] INFO: Found listing with ID: HT16373
2026-03-27 12:11:37 [auto1.nl] INFO: Found listing with ID: WV31023
2026-03-27 12:11:37 [auto1.nl] INFO: Found listing with ID: MC01443
2026-03-27 12:11:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MC01443%27 HTTP/1.1" 200 None
2026-03-27 12:11:37 [auto1.nl] INFO: Scrape type for MC01443: 0
2026-03-27 12:11:37 [auto1.nl] INFO: Found listing with ID: RV40948
2026-03-27 12:11:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RV40948%27 HTTP/1.1" 200 None
2026-03-27 12:11:37 [auto1.nl] INFO: Scrape type for RV40948: 0
2026-03-27 12:11:37 [auto1.nl] INFO: Found listing with ID: PE73396
2026-03-27 12:11:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PE73396%27 HTTP/1.1" 200 None
2026-03-27 12:11:37 [auto1.nl] INFO: Scrape type for PE73396: 0
2026-03-27 12:11:37 [auto1.nl] INFO: Found listing with ID: PN49901
2026-03-27 12:11:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PN49901%27 HTTP/1.1" 200 None
2026-03-27 12:11:37 [auto1.nl] INFO: Scrape type for PN49901: 0
2026-03-27 12:11:37 [auto1.nl] INFO: Found listing with ID: GJ39127
2026-03-27 12:11:37 [auto1.nl] INFO: Found listing with ID: LD75991
2026-03-27 12:11:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LD75991%27 HTTP/1.1" 200 None
2026-03-27 12:11:37 [auto1.nl] INFO: Scrape type for LD75991: 0
2026-03-27 12:11:37 [auto1.nl] INFO: Found listing with ID: CP01462
2026-03-27 12:11:37 [auto1.nl] INFO: Found listing with ID: SG20975
2026-03-27 12:11:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SG20975%27 HTTP/1.1" 200 None
2026-03-27 12:11:37 [auto1.nl] INFO: Scrape type for SG20975: 0
2026-03-27 12:11:37 [auto1.nl] INFO: Found listing with ID: SG77636
2026-03-27 12:11:37 [auto1.nl] INFO: Found listing with ID: EF55235
2026-03-27 12:11:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EF55235%27 HTTP/1.1" 200 None
2026-03-27 12:11:37 [auto1.nl] INFO: Scrape type for EF55235: 0
2026-03-27 12:11:37 [auto1.nl] INFO: Found listing with ID: CZ22404
2026-03-27 12:11:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CZ22404%27 HTTP/1.1" 200 None
2026-03-27 12:11:37 [auto1.nl] INFO: Scrape type for CZ22404: 0
2026-03-27 12:11:37 [auto1.nl] INFO: Found listing with ID: TL32110
2026-03-27 12:11:37 [auto1.nl] INFO: Found listing with ID: LN57581
2026-03-27 12:11:37 [auto1.nl] INFO: Found listing with ID: ZZ83139
2026-03-27 12:11:37 [auto1.nl] INFO: Found listing with ID: CA77037
2026-03-27 12:11:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CA77037%27 HTTP/1.1" 200 None
2026-03-27 12:11:37 [auto1.nl] INFO: Scrape type for CA77037: 0
2026-03-27 12:11:37 [auto1.nl] INFO: Found listing with ID: ZE62663
2026-03-27 12:11:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZE62663%27 HTTP/1.1" 200 None
2026-03-27 12:11:37 [auto1.nl] INFO: Scrape type for ZE62663: 0
2026-03-27 12:11:37 [auto1.nl] INFO: Found listing with ID: LM76108
2026-03-27 12:11:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LM76108%27 HTTP/1.1" 200 None
2026-03-27 12:11:37 [auto1.nl] INFO: Scrape type for LM76108: 0
2026-03-27 12:11:37 [auto1.nl] INFO: Found listing with ID: JK78904
2026-03-27 12:11:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JK78904%27 HTTP/1.1" 200 None
2026-03-27 12:11:37 [auto1.nl] INFO: Scrape type for JK78904: 0
2026-03-27 12:11:37 [auto1.nl] INFO: Found listing with ID: RC82380
2026-03-27 12:11:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RC82380%27 HTTP/1.1" 200 None
2026-03-27 12:11:37 [auto1.nl] INFO: Scrape type for RC82380: 0
2026-03-27 12:11:37 [auto1.nl] INFO: Found listing with ID: SE52210
2026-03-27 12:11:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SE52210%27 HTTP/1.1" 200 None
2026-03-27 12:11:37 [auto1.nl] INFO: Scrape type for SE52210: 0
2026-03-27 12:11:37 [auto1.nl] INFO: Found listing with ID: SY25778
2026-03-27 12:11:37 [auto1.nl] INFO: Found listing with ID: TD45630
2026-03-27 12:11:37 [auto1.nl] INFO: Found listing with ID: MK25507
2026-03-27 12:11:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MK25507%27 HTTP/1.1" 200 None
2026-03-27 12:11:37 [auto1.nl] INFO: Scrape type for MK25507: 0
2026-03-27 12:11:37 [auto1.nl] INFO: Found listing with ID: AY95318
2026-03-27 12:11:37 [auto1.nl] INFO: Found listing with ID: SB09763
2026-03-27 12:11:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SB09763%27 HTTP/1.1" 200 None
2026-03-27 12:11:37 [auto1.nl] INFO: Scrape type for SB09763: 0
2026-03-27 12:11:37 [auto1.nl] INFO: Found listing with ID: JX67409
2026-03-27 12:11:37 [auto1.nl] INFO: Found listing with ID: TG63476
2026-03-27 12:11:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TG63476%27 HTTP/1.1" 200 None
2026-03-27 12:11:37 [auto1.nl] INFO: Scrape type for TG63476: 0
2026-03-27 12:11:37 [auto1.nl] INFO: Found listing with ID: FL22944
2026-03-27 12:11:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FL22944%27 HTTP/1.1" 200 None
2026-03-27 12:11:37 [auto1.nl] INFO: Scrape type for FL22944: 0
2026-03-27 12:11:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 12:11:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:11:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7cfdef8390>
2026-03-27 12:11:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:11:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:11:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:11:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_76a1108c-b5d7-57a0-89e5-34b437f0fb40/76a1108c-b5d7-57a0-89e5-34b437f0fb40_image_0.jpg HTTP/1.1" 201 0
2026-03-27 12:11:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg88%252Fb9%252F88b92cdb4c8063993bcba71c3252525f%252Fpa%252FFR68688_345b87a1fb1aaaa2b27584bd925544a0.jpg') HTTP/1.1" 204 0
2026-03-27 12:11:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img88/b9/88b92cdb4c8063993bcba71c3252525f/pa/FR68688_345b87a1fb1aaaa2b27584bd925544a0.jpg saved to cache
2026-03-27 12:11:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 76a1108c-b5d7-57a0-89e5-34b437f0fb40
2026-03-27 12:11:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:11:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7cfcce3750>
2026-03-27 12:11:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:11:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:11:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:11:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_76a1108c-b5d7-57a0-89e5-34b437f0fb40/76a1108c-b5d7-57a0-89e5-34b437f0fb40_image_1.jpg HTTP/1.1" 201 0
2026-03-27 12:11:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimg88%252Fb9%252F88b92cdb4c8063993bcba71c3252525f%252Fpa%252FFR68688_cbfd8add973ff71b5c791446074e6c33.jpg') HTTP/1.1" 204 0
2026-03-27 12:11:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/img88/b9/88b92cdb4c8063993bcba71c3252525f/pa/FR68688_cbfd8add973ff71b5c791446074e6c33.jpg saved to cache
2026-03-27 12:11:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 76a1108c-b5d7-57a0-89e5-34b437f0fb40
2026-03-27 12:11:37 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 76a1108c-b5d7-57a0-89e5-34b437f0fb40, skipping ID generation
2026-03-27 12:11:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 76a1108c-b5d7-57a0-89e5-34b437f0fb40 with scrape type 1
2026-03-27 12:11:37 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 76a1108c-b5d7-57a0-89e5-34b437f0fb40 sending to next pipeline
2026-03-27 12:11:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 76a1108c-b5d7-57a0-89e5-34b437f0fb40, identifier: FR68688
2026-03-27 12:11:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 76a1108c-b5d7-57a0-89e5-34b437f0fb40 with identifier: FR68688
2026-03-27 12:11:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 76a1108c-b5d7-57a0-89e5-34b437f0fb40 with identifier: FR68688
2026-03-27 12:11:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 76a1108c-b5d7-57a0-89e5-34b437f0fb40 with identifier: FR68688 to the API
2026-03-27 12:11:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 12:11:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 12:11:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/img88/b9/88b92cdb4c8063993bcba71c3252525f/pa/FR68688_cbfd8add973ff71b5c791446074e6c33.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine': '1.0L',
 'engine_horse_power': 68,
 'expiration_date': '2026-03-28T16:24:59Z',
 'fuel_type': 'petrol',
 'id': '76a1108c-b5d7-57a0-89e5-34b437f0fb40',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': '50PBH9',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FR68688',
 'listing': 'auction',
 'location': 'NL, Oosterhout',
 'make': 'Peugeot',
 'model': '107',
 'odometer': 270252,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 5,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_76a1108c-b5d7-57a0-89e5-34b437f0fb40/76a1108c-b5d7-57a0-89e5-34b437f0fb40_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65124,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img88/b9/88b92cdb4c8063993bcba71c3252525f/pa/FR68688_345b87a1fb1aaaa2b27584bd925544a0.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_76a1108c-b5d7-57a0-89e5-34b437f0fb40/76a1108c-b5d7-57a0-89e5-34b437f0fb40_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67174,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img88/b9/88b92cdb4c8063993bcba71c3252525f/pa/FR68688_cbfd8add973ff71b5c791446074e6c33.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_76a1108c-b5d7-57a0-89e5-34b437f0fb40/76a1108c-b5d7-57a0-89e5-34b437f0fb40_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 69854,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img88/b9/88b92cdb4c8063993bcba71c3252525f/pa/FR68688_a2205b6789f68f012b4d5022f2b5e650.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_76a1108c-b5d7-57a0-89e5-34b437f0fb40/76a1108c-b5d7-57a0-89e5-34b437f0fb40_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 67136,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img88/b9/88b92cdb4c8063993bcba71c3252525f/pa/FR68688_97dd5441d669215b6f0cc95d124a13d5.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_76a1108c-b5d7-57a0-89e5-34b437f0fb40/76a1108c-b5d7-57a0-89e5-34b437f0fb40_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 78945,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/img88/b9/88b92cdb4c8063993bcba71c3252525f/pa/FR68688_51494f4f82e13a8930ca89de3757778a.jpg',
             'Width': 800}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2011-01-05',
 'seats_number': 4,
 'seller_name': None,
 'title': 'Peugeot 107 1.0 Filou',
 'transmission': 'manual',
 'trim': 'Filou',
 'year': 2011}
2026-03-27 12:11:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FR68688%27 HTTP/1.1" 200 None
2026-03-27 12:11:38 [auto1.nl] INFO: Saving data for FR68688: {'created_time': 1774613498.176328, 'last_price_update_time': 1774613498.17634, 'auction_closing_time': 1774715099.0}
2026-03-27 12:11:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='FR68688') HTTP/1.1" 204 0
2026-03-27 12:11:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgad/6e/ad6e8af8eba6a705687e20417a1d542b/pa/DZ87358_1cbecb094189d1ee76cd8276f6d4a1e2.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:11:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgad/6e/ad6e8af8eba6a705687e20417a1d542b/pa/DZ87358_bcba7294466a2ced4079e5ec7d4cb9a3.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:11:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgad/6e/ad6e8af8eba6a705687e20417a1d542b/pa/DZ87358_aec884f588e96bb06b59b45fba35ba55.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:11:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgad/6e/ad6e8af8eba6a705687e20417a1d542b/pa/DZ87358_52852438e1fd90770d24231382fe1626.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:11:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://img-pa.auto1.com/imgad/6e/ad6e8af8eba6a705687e20417a1d542b/pa/DZ87358_604cc18ec0db46f6a5dcc083ad4e8ea8.jpg> (referer: https://www.auto1.com/)
2026-03-27 12:11:38 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 12:11:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:11:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7cfe003050>
2026-03-27 12:11:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:11:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:11:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:11:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b47c1438-9d9a-5327-a4a1-85cd6f1b2c1d/b47c1438-9d9a-5327-a4a1-85cd6f1b2c1d_image_2.jpg HTTP/1.1" 201 0
2026-03-27 12:11:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252F6e%252Fad6e8af8eba6a705687e20417a1d542b%252Fpa%252FDZ87358_1cbecb094189d1ee76cd8276f6d4a1e2.jpg') HTTP/1.1" 204 0
2026-03-27 12:11:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/6e/ad6e8af8eba6a705687e20417a1d542b/pa/DZ87358_1cbecb094189d1ee76cd8276f6d4a1e2.jpg saved to cache
2026-03-27 12:11:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b47c1438-9d9a-5327-a4a1-85cd6f1b2c1d
2026-03-27 12:11:38 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 12:11:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:11:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7cfccb5710>
2026-03-27 12:11:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:11:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:11:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:11:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b47c1438-9d9a-5327-a4a1-85cd6f1b2c1d/b47c1438-9d9a-5327-a4a1-85cd6f1b2c1d_image_6.jpg HTTP/1.1" 201 0
2026-03-27 12:11:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252F6e%252Fad6e8af8eba6a705687e20417a1d542b%252Fpa%252FDZ87358_bcba7294466a2ced4079e5ec7d4cb9a3.jpg') HTTP/1.1" 204 0
2026-03-27 12:11:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/6e/ad6e8af8eba6a705687e20417a1d542b/pa/DZ87358_bcba7294466a2ced4079e5ec7d4cb9a3.jpg saved to cache
2026-03-27 12:11:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b47c1438-9d9a-5327-a4a1-85cd6f1b2c1d
2026-03-27 12:11:38 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 12:11:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:11:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7cfcdaf3d0>
2026-03-27 12:11:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:11:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:11:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:11:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b47c1438-9d9a-5327-a4a1-85cd6f1b2c1d/b47c1438-9d9a-5327-a4a1-85cd6f1b2c1d_image_9.jpg HTTP/1.1" 201 0
2026-03-27 12:11:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252F6e%252Fad6e8af8eba6a705687e20417a1d542b%252Fpa%252FDZ87358_aec884f588e96bb06b59b45fba35ba55.jpg') HTTP/1.1" 204 0
2026-03-27 12:11:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/6e/ad6e8af8eba6a705687e20417a1d542b/pa/DZ87358_aec884f588e96bb06b59b45fba35ba55.jpg saved to cache
2026-03-27 12:11:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item b47c1438-9d9a-5327-a4a1-85cd6f1b2c1d
2026-03-27 12:11:38 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 12:11:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:11:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7cfcc99d90>
2026-03-27 12:11:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:11:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:11:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:11:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b47c1438-9d9a-5327-a4a1-85cd6f1b2c1d/b47c1438-9d9a-5327-a4a1-85cd6f1b2c1d_image_7.jpg HTTP/1.1" 201 0
2026-03-27 12:11:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252F6e%252Fad6e8af8eba6a705687e20417a1d542b%252Fpa%252FDZ87358_52852438e1fd90770d24231382fe1626.jpg') HTTP/1.1" 204 0
2026-03-27 12:11:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/6e/ad6e8af8eba6a705687e20417a1d542b/pa/DZ87358_52852438e1fd90770d24231382fe1626.jpg saved to cache
2026-03-27 12:11:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b47c1438-9d9a-5327-a4a1-85cd6f1b2c1d
2026-03-27 12:11:38 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'\x00\x00\x00\x1a'
2026-03-27 12:11:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-27 12:11:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f7cfdfc38d0>
2026-03-27 12:11:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-27 12:11:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-27 12:11:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-27 12:11:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b47c1438-9d9a-5327-a4a1-85cd6f1b2c1d/b47c1438-9d9a-5327-a4a1-85cd6f1b2c1d_image_5.jpg HTTP/1.1" 201 0
2026-03-27 12:11:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='auto1.nl',RowKey='https%3A%252F%252Fimg-pa.auto1.com%252Fimgad%252F6e%252Fad6e8af8eba6a705687e20417a1d542b%252Fpa%252FDZ87358_604cc18ec0db46f6a5dcc083ad4e8ea8.jpg') HTTP/1.1" 204 0
2026-03-27 12:11:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://img-pa.auto1.com/imgad/6e/ad6e8af8eba6a705687e20417a1d542b/pa/DZ87358_604cc18ec0db46f6a5dcc083ad4e8ea8.jpg saved to cache
2026-03-27 12:11:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b47c1438-9d9a-5327-a4a1-85cd6f1b2c1d
2026-03-27 12:11:39 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b47c1438-9d9a-5327-a4a1-85cd6f1b2c1d, skipping ID generation
2026-03-27 12:11:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b47c1438-9d9a-5327-a4a1-85cd6f1b2c1d with scrape type 1
2026-03-27 12:11:39 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b47c1438-9d9a-5327-a4a1-85cd6f1b2c1d sending to next pipeline
2026-03-27 12:11:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: b47c1438-9d9a-5327-a4a1-85cd6f1b2c1d, identifier: DZ87358
2026-03-27 12:11:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: b47c1438-9d9a-5327-a4a1-85cd6f1b2c1d with identifier: DZ87358
2026-03-27 12:11:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: b47c1438-9d9a-5327-a4a1-85cd6f1b2c1d with identifier: DZ87358
2026-03-27 12:11:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: b47c1438-9d9a-5327-a4a1-85cd6f1b2c1d with identifier: DZ87358 to the API
2026-03-27 12:11:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 12:11:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 12:11:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://img-pa.auto1.com/imgad/6e/ad6e8af8eba6a705687e20417a1d542b/pa/DZ87358_604cc18ec0db46f6a5dcc083ad4e8ea8.jpg>
{'auction_title': '',
 'c_o_2_emission_value': None,
 'category': None,
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'emission_standard': 'EURO 5',
 'engine': '3.0L',
 'engine_horse_power': 258,
 'expiration_date': '2026-03-28T16:26:15Z',
 'fuel_type': 'diesel',
 'id': 'b47c1438-9d9a-5327-a4a1-85cd6f1b2c1d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'license_plate': 'Pd552t',
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DZ87358',
 'listing': 'auction',
 'location': 'NL, Amersfoort',
 'make': 'BMW',
 'model': '5er',
 'odometer': 200238,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 15,
 'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b47c1438-9d9a-5327-a4a1-85cd6f1b2c1d/b47c1438-9d9a-5327-a4a1-85cd6f1b2c1d_image_0.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 73520,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgad/6e/ad6e8af8eba6a705687e20417a1d542b/pa/DZ87358_9bb9e4d07e98381808e8de15d34cb112.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b47c1438-9d9a-5327-a4a1-85cd6f1b2c1d/b47c1438-9d9a-5327-a4a1-85cd6f1b2c1d_image_1.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 65879,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgad/6e/ad6e8af8eba6a705687e20417a1d542b/pa/DZ87358_86650efde068e9d6f6833cf4eb484eb9.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b47c1438-9d9a-5327-a4a1-85cd6f1b2c1d/b47c1438-9d9a-5327-a4a1-85cd6f1b2c1d_image_2.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2654151,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgad/6e/ad6e8af8eba6a705687e20417a1d542b/pa/DZ87358_1cbecb094189d1ee76cd8276f6d4a1e2.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b47c1438-9d9a-5327-a4a1-85cd6f1b2c1d/b47c1438-9d9a-5327-a4a1-85cd6f1b2c1d_image_3.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 57383,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgad/6e/ad6e8af8eba6a705687e20417a1d542b/pa/DZ87358_3d1c6a73393c156c5b5578fef4719be8.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b47c1438-9d9a-5327-a4a1-85cd6f1b2c1d/b47c1438-9d9a-5327-a4a1-85cd6f1b2c1d_image_4.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 59496,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgad/6e/ad6e8af8eba6a705687e20417a1d542b/pa/DZ87358_a402dcb405e7389bab507f391110216b.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b47c1438-9d9a-5327-a4a1-85cd6f1b2c1d/b47c1438-9d9a-5327-a4a1-85cd6f1b2c1d_image_5.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2780908,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgad/6e/ad6e8af8eba6a705687e20417a1d542b/pa/DZ87358_604cc18ec0db46f6a5dcc083ad4e8ea8.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b47c1438-9d9a-5327-a4a1-85cd6f1b2c1d/b47c1438-9d9a-5327-a4a1-85cd6f1b2c1d_image_6.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2469690,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgad/6e/ad6e8af8eba6a705687e20417a1d542b/pa/DZ87358_bcba7294466a2ced4079e5ec7d4cb9a3.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b47c1438-9d9a-5327-a4a1-85cd6f1b2c1d/b47c1438-9d9a-5327-a4a1-85cd6f1b2c1d_image_7.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2629009,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgad/6e/ad6e8af8eba6a705687e20417a1d542b/pa/DZ87358_52852438e1fd90770d24231382fe1626.jpg',
             'Width': 2048},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b47c1438-9d9a-5327-a4a1-85cd6f1b2c1d/b47c1438-9d9a-5327-a4a1-85cd6f1b2c1d_image_8.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 62532,
             'Height': 600,
             'OriginUrl': 'https://img-pa.auto1.com/imgad/6e/ad6e8af8eba6a705687e20417a1d542b/pa/DZ87358_178839568a7535ae001b3f3be8f06e98.jpg',
             'Width': 800},
            {'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b47c1438-9d9a-5327-a4a1-85cd6f1b2c1d/b47c1438-9d9a-5327-a4a1-85cd6f1b2c1d_image_9.jpg',
             'Extension': 'jpg',
             'FileSizeInBytes': 2570564,
             'Height': 1536,
             'OriginUrl': 'https://img-pa.auto1.com/imgad/6e/ad6e8af8eba6a705687e20417a1d542b/pa/DZ87358_aec884f588e96bb06b59b45fba35ba55.jpg',
             'Width': 2048}],
 'price': 0,
 'price_includes_vat': True,
 'registration_date': '2012-05-23',
 'seats_number': 5,
 'seller_name': None,
 'title': 'BMW 5er 530d xDrive',
 'transmission': 'automatic',
 'trim': 'xDrive',
 'year': 2012}
2026-03-27 12:11:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DZ87358%27 HTTP/1.1" 200 None
2026-03-27 12:11:39 [auto1.nl] INFO: Saving data for DZ87358: {'created_time': 1774613499.48183, 'last_price_update_time': 1774613499.48184, 'auction_closing_time': 1774715175.0}
2026-03-27 12:11:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='DZ87358') HTTP/1.1" 204 0
2026-03-27 12:11:40 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 12:11:40 [auto1.nl] INFO: Channel: 24h | Page: 10 | totalHits: 1060 | hits on page: 40
2026-03-27 12:11:40 [auto1.nl] INFO: Found listing with ID: VF97157
2026-03-27 12:11:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VF97157%27 HTTP/1.1" 200 None
2026-03-27 12:11:40 [auto1.nl] INFO: Scrape type for VF97157: 0
2026-03-27 12:11:40 [auto1.nl] INFO: Found listing with ID: EV30454
2026-03-27 12:11:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EV30454%27 HTTP/1.1" 200 None
2026-03-27 12:11:40 [auto1.nl] INFO: Scrape type for EV30454: 0
2026-03-27 12:11:40 [auto1.nl] INFO: Found listing with ID: AU83967
2026-03-27 12:11:40 [auto1.nl] INFO: Found listing with ID: AA68968
2026-03-27 12:11:40 [auto1.nl] INFO: Found listing with ID: YW05960
2026-03-27 12:11:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YW05960%27 HTTP/1.1" 200 None
2026-03-27 12:11:40 [auto1.nl] INFO: Scrape type for YW05960: 0
2026-03-27 12:11:40 [auto1.nl] INFO: Found listing with ID: ZX00251
2026-03-27 12:11:40 [auto1.nl] INFO: Found listing with ID: BG45201
2026-03-27 12:11:40 [auto1.nl] INFO: Found listing with ID: HP34422
2026-03-27 12:11:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HP34422%27 HTTP/1.1" 200 None
2026-03-27 12:11:40 [auto1.nl] INFO: Scrape type for HP34422: 0
2026-03-27 12:11:40 [auto1.nl] INFO: Found listing with ID: JH65457
2026-03-27 12:11:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JH65457%27 HTTP/1.1" 200 None
2026-03-27 12:11:40 [auto1.nl] INFO: Scrape type for JH65457: 0
2026-03-27 12:11:40 [auto1.nl] INFO: Found listing with ID: XD61678
2026-03-27 12:11:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XD61678%27 HTTP/1.1" 200 None
2026-03-27 12:11:40 [auto1.nl] INFO: Scrape type for XD61678: 0
2026-03-27 12:11:40 [auto1.nl] INFO: Found listing with ID: ZL96236
2026-03-27 12:11:40 [auto1.nl] INFO: Found listing with ID: MA73251
2026-03-27 12:11:40 [auto1.nl] INFO: Found listing with ID: RX88185
2026-03-27 12:11:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RX88185%27 HTTP/1.1" 200 None
2026-03-27 12:11:40 [auto1.nl] INFO: Scrape type for RX88185: 0
2026-03-27 12:11:40 [auto1.nl] INFO: Found listing with ID: HC20329
2026-03-27 12:11:40 [auto1.nl] INFO: Found listing with ID: KF17287
2026-03-27 12:11:40 [auto1.nl] INFO: Found listing with ID: LZ16632
2026-03-27 12:11:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LZ16632%27 HTTP/1.1" 200 None
2026-03-27 12:11:40 [auto1.nl] INFO: Scrape type for LZ16632: 0
2026-03-27 12:11:40 [auto1.nl] INFO: Found listing with ID: TS92650
2026-03-27 12:11:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TS92650%27 HTTP/1.1" 200 None
2026-03-27 12:11:40 [auto1.nl] INFO: Scrape type for TS92650: 0
2026-03-27 12:11:40 [auto1.nl] INFO: Found listing with ID: AU62322
2026-03-27 12:11:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AU62322%27 HTTP/1.1" 200 None
2026-03-27 12:11:40 [auto1.nl] INFO: Scrape type for AU62322: 0
2026-03-27 12:11:40 [auto1.nl] INFO: Found listing with ID: HZ22754
2026-03-27 12:11:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HZ22754%27 HTTP/1.1" 200 None
2026-03-27 12:11:40 [auto1.nl] INFO: Scrape type for HZ22754: 0
2026-03-27 12:11:40 [auto1.nl] INFO: Found listing with ID: HJ57971
2026-03-27 12:11:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HJ57971%27 HTTP/1.1" 200 None
2026-03-27 12:11:40 [auto1.nl] INFO: Scrape type for HJ57971: 0
2026-03-27 12:11:40 [auto1.nl] INFO: Found listing with ID: UU65175
2026-03-27 12:11:40 [auto1.nl] INFO: Found listing with ID: RT17699
2026-03-27 12:11:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RT17699%27 HTTP/1.1" 200 None
2026-03-27 12:11:40 [auto1.nl] INFO: Scrape type for RT17699: 0
2026-03-27 12:11:40 [auto1.nl] INFO: Found listing with ID: FN38553
2026-03-27 12:11:40 [auto1.nl] INFO: Found listing with ID: AK82229
2026-03-27 12:11:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AK82229%27 HTTP/1.1" 200 None
2026-03-27 12:11:40 [auto1.nl] INFO: Scrape type for AK82229: 0
2026-03-27 12:11:40 [auto1.nl] INFO: Found listing with ID: WC13329
2026-03-27 12:11:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WC13329%27 HTTP/1.1" 200 None
2026-03-27 12:11:40 [auto1.nl] INFO: Scrape type for WC13329: 0
2026-03-27 12:11:40 [auto1.nl] INFO: Found listing with ID: AM37738
2026-03-27 12:11:40 [auto1.nl] INFO: Found listing with ID: BC52928
2026-03-27 12:11:40 [auto1.nl] INFO: Found listing with ID: AW15981
2026-03-27 12:11:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AW15981%27 HTTP/1.1" 200 None
2026-03-27 12:11:40 [auto1.nl] INFO: Scrape type for AW15981: 0
2026-03-27 12:11:40 [auto1.nl] INFO: Found listing with ID: EZ08560
2026-03-27 12:11:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EZ08560%27 HTTP/1.1" 200 None
2026-03-27 12:11:40 [auto1.nl] INFO: Scrape type for EZ08560: 0
2026-03-27 12:11:40 [auto1.nl] INFO: Found listing with ID: YK98733
2026-03-27 12:11:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YK98733%27 HTTP/1.1" 200 None
2026-03-27 12:11:40 [auto1.nl] INFO: Scrape type for YK98733: 0
2026-03-27 12:11:40 [auto1.nl] INFO: Found listing with ID: GT38970
2026-03-27 12:11:40 [auto1.nl] INFO: Found listing with ID: PR00760
2026-03-27 12:11:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PR00760%27 HTTP/1.1" 200 None
2026-03-27 12:11:40 [auto1.nl] INFO: Scrape type for PR00760: 0
2026-03-27 12:11:40 [auto1.nl] INFO: Found listing with ID: JF28004
2026-03-27 12:11:40 [auto1.nl] INFO: Found listing with ID: ZJ89710
2026-03-27 12:11:40 [auto1.nl] INFO: Found listing with ID: HS94001
2026-03-27 12:11:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HS94001%27 HTTP/1.1" 200 None
2026-03-27 12:11:40 [auto1.nl] INFO: Scrape type for HS94001: 0
2026-03-27 12:11:40 [auto1.nl] INFO: Found listing with ID: WG43530
2026-03-27 12:11:40 [auto1.nl] INFO: Found listing with ID: YZ79316
2026-03-27 12:11:40 [auto1.nl] INFO: Found listing with ID: EH98197
2026-03-27 12:11:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EH98197%27 HTTP/1.1" 200 None
2026-03-27 12:11:40 [auto1.nl] INFO: Scrape type for EH98197: 0
2026-03-27 12:11:40 [auto1.nl] INFO: Found listing with ID: JD04628
2026-03-27 12:11:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JD04628%27 HTTP/1.1" 200 None
2026-03-27 12:11:40 [auto1.nl] INFO: Scrape type for JD04628: 0
2026-03-27 12:11:40 [auto1.nl] INFO: Found listing with ID: YS44884
2026-03-27 12:11:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 12:11:41 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 12:11:41 [auto1.nl] INFO: Channel: 24h | Page: 11 | totalHits: 1060 | hits on page: 40
2026-03-27 12:11:41 [auto1.nl] INFO: Found listing with ID: RS83136
2026-03-27 12:11:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RS83136%27 HTTP/1.1" 200 None
2026-03-27 12:11:41 [auto1.nl] INFO: Scrape type for RS83136: 0
2026-03-27 12:11:41 [auto1.nl] INFO: Found listing with ID: UP10954
2026-03-27 12:11:41 [auto1.nl] INFO: Found listing with ID: YP02517
2026-03-27 12:11:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YP02517%27 HTTP/1.1" 200 None
2026-03-27 12:11:41 [auto1.nl] INFO: Scrape type for YP02517: 0
2026-03-27 12:11:41 [auto1.nl] INFO: Found listing with ID: LM91358
2026-03-27 12:11:41 [auto1.nl] INFO: Found listing with ID: UR05111
2026-03-27 12:11:41 [auto1.nl] INFO: Found listing with ID: FS52541
2026-03-27 12:11:41 [auto1.nl] INFO: Found listing with ID: BD70921
2026-03-27 12:11:41 [auto1.nl] INFO: Found listing with ID: XF96679
2026-03-27 12:11:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XF96679%27 HTTP/1.1" 200 None
2026-03-27 12:11:41 [auto1.nl] INFO: Scrape type for XF96679: 0
2026-03-27 12:11:41 [auto1.nl] INFO: Found listing with ID: JY10471
2026-03-27 12:11:41 [auto1.nl] INFO: Found listing with ID: GR34057
2026-03-27 12:11:41 [auto1.nl] INFO: Found listing with ID: VK93798
2026-03-27 12:11:41 [auto1.nl] INFO: Found listing with ID: VC90690
2026-03-27 12:11:41 [auto1.nl] INFO: Found listing with ID: WT58034
2026-03-27 12:11:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WT58034%27 HTTP/1.1" 200 None
2026-03-27 12:11:41 [auto1.nl] INFO: Scrape type for WT58034: 0
2026-03-27 12:11:41 [auto1.nl] INFO: Found listing with ID: ZC98390
2026-03-27 12:11:41 [auto1.nl] INFO: Found listing with ID: CT33504
2026-03-27 12:11:41 [auto1.nl] INFO: Found listing with ID: TV78325
2026-03-27 12:11:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TV78325%27 HTTP/1.1" 200 None
2026-03-27 12:11:41 [auto1.nl] INFO: Scrape type for TV78325: 0
2026-03-27 12:11:41 [auto1.nl] INFO: Found listing with ID: BD34188
2026-03-27 12:11:41 [auto1.nl] INFO: Found listing with ID: FD33602
2026-03-27 12:11:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FD33602%27 HTTP/1.1" 200 None
2026-03-27 12:11:41 [auto1.nl] INFO: Scrape type for FD33602: 0
2026-03-27 12:11:41 [auto1.nl] INFO: Found listing with ID: PB13683
2026-03-27 12:11:41 [auto1.nl] INFO: Found listing with ID: RY27630
2026-03-27 12:11:41 [auto1.nl] INFO: Found listing with ID: BA16838
2026-03-27 12:11:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BA16838%27 HTTP/1.1" 200 None
2026-03-27 12:11:41 [auto1.nl] INFO: Scrape type for BA16838: 0
2026-03-27 12:11:41 [auto1.nl] INFO: Found listing with ID: DY04766
2026-03-27 12:11:41 [auto1.nl] INFO: Found listing with ID: WA13538
2026-03-27 12:11:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WA13538%27 HTTP/1.1" 200 None
2026-03-27 12:11:41 [auto1.nl] INFO: Scrape type for WA13538: 0
2026-03-27 12:11:41 [auto1.nl] INFO: Found listing with ID: VR98847
2026-03-27 12:11:41 [auto1.nl] INFO: Found listing with ID: VW77077
2026-03-27 12:11:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VW77077%27 HTTP/1.1" 200 None
2026-03-27 12:11:41 [auto1.nl] INFO: Scrape type for VW77077: 0
2026-03-27 12:11:41 [auto1.nl] INFO: Found listing with ID: SD39656
2026-03-27 12:11:41 [auto1.nl] INFO: Found listing with ID: ZS06916
2026-03-27 12:11:41 [auto1.nl] INFO: Found listing with ID: JJ43979
2026-03-27 12:11:41 [auto1.nl] INFO: Found listing with ID: GW15283
2026-03-27 12:11:41 [auto1.nl] INFO: Found listing with ID: FM74827
2026-03-27 12:11:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FM74827%27 HTTP/1.1" 200 None
2026-03-27 12:11:41 [auto1.nl] INFO: Scrape type for FM74827: 0
2026-03-27 12:11:41 [auto1.nl] INFO: Found listing with ID: TV23834
2026-03-27 12:11:41 [auto1.nl] INFO: Found listing with ID: YE36776
2026-03-27 12:11:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YE36776%27 HTTP/1.1" 200 None
2026-03-27 12:11:41 [auto1.nl] INFO: Scrape type for YE36776: 0
2026-03-27 12:11:41 [auto1.nl] INFO: Found listing with ID: DL89712
2026-03-27 12:11:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DL89712%27 HTTP/1.1" 200 None
2026-03-27 12:11:41 [auto1.nl] INFO: Scrape type for DL89712: 0
2026-03-27 12:11:41 [auto1.nl] INFO: Found listing with ID: GN78419
2026-03-27 12:11:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GN78419%27 HTTP/1.1" 200 None
2026-03-27 12:11:41 [auto1.nl] INFO: Scrape type for GN78419: 0
2026-03-27 12:11:41 [auto1.nl] INFO: Found listing with ID: AW32002
2026-03-27 12:11:41 [auto1.nl] INFO: Found listing with ID: AG27565
2026-03-27 12:11:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AG27565%27 HTTP/1.1" 200 None
2026-03-27 12:11:41 [auto1.nl] INFO: Scrape type for AG27565: 0
2026-03-27 12:11:41 [auto1.nl] INFO: Found listing with ID: ZV82416
2026-03-27 12:11:41 [auto1.nl] INFO: Found listing with ID: TD05711
2026-03-27 12:11:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TD05711%27 HTTP/1.1" 200 None
2026-03-27 12:11:41 [auto1.nl] INFO: Scrape type for TD05711: 0
2026-03-27 12:11:41 [auto1.nl] INFO: Found listing with ID: US61568
2026-03-27 12:11:41 [auto1.nl] INFO: Found listing with ID: ZV50646
2026-03-27 12:11:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZV50646%27 HTTP/1.1" 200 None
2026-03-27 12:11:41 [auto1.nl] INFO: Scrape type for ZV50646: 0
2026-03-27 12:11:41 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 12:11:42 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 12:11:42 [auto1.nl] INFO: Channel: 24h | Page: 12 | totalHits: 1060 | hits on page: 40
2026-03-27 12:11:42 [auto1.nl] INFO: Found listing with ID: BJ91492
2026-03-27 12:11:42 [auto1.nl] INFO: Found listing with ID: BN62870
2026-03-27 12:11:42 [auto1.nl] INFO: Found listing with ID: XK13830
2026-03-27 12:11:42 [auto1.nl] INFO: Found listing with ID: UC83701
2026-03-27 12:11:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UC83701%27 HTTP/1.1" 200 None
2026-03-27 12:11:42 [auto1.nl] INFO: Scrape type for UC83701: 0
2026-03-27 12:11:42 [auto1.nl] INFO: Found listing with ID: TG85730
2026-03-27 12:11:42 [auto1.nl] INFO: Found listing with ID: NT93332
2026-03-27 12:11:42 [auto1.nl] INFO: Found listing with ID: RU64557
2026-03-27 12:11:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RU64557%27 HTTP/1.1" 200 None
2026-03-27 12:11:43 [auto1.nl] INFO: Scrape type for RU64557: 0
2026-03-27 12:11:43 [auto1.nl] INFO: Found listing with ID: AY12537
2026-03-27 12:11:43 [auto1.nl] INFO: Found listing with ID: XF65643
2026-03-27 12:11:43 [auto1.nl] INFO: Found listing with ID: AK57667
2026-03-27 12:11:43 [auto1.nl] INFO: Found listing with ID: NT74232
2026-03-27 12:11:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NT74232%27 HTTP/1.1" 200 None
2026-03-27 12:11:43 [auto1.nl] INFO: Scrape type for NT74232: 0
2026-03-27 12:11:43 [auto1.nl] INFO: Found listing with ID: VB53474
2026-03-27 12:11:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VB53474%27 HTTP/1.1" 200 None
2026-03-27 12:11:43 [auto1.nl] INFO: Scrape type for VB53474: 0
2026-03-27 12:11:43 [auto1.nl] INFO: Found listing with ID: NT44223
2026-03-27 12:11:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NT44223%27 HTTP/1.1" 200 None
2026-03-27 12:11:43 [auto1.nl] INFO: Scrape type for NT44223: 0
2026-03-27 12:11:43 [auto1.nl] INFO: Found listing with ID: FU18655
2026-03-27 12:11:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FU18655%27 HTTP/1.1" 200 None
2026-03-27 12:11:43 [auto1.nl] INFO: Scrape type for FU18655: 0
2026-03-27 12:11:43 [auto1.nl] INFO: Found listing with ID: FJ71499
2026-03-27 12:11:43 [auto1.nl] INFO: Found listing with ID: KR75756
2026-03-27 12:11:43 [auto1.nl] INFO: Found listing with ID: CP38443
2026-03-27 12:11:43 [auto1.nl] INFO: Found listing with ID: AY73779
2026-03-27 12:11:43 [auto1.nl] INFO: Found listing with ID: LN50164
2026-03-27 12:11:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LN50164%27 HTTP/1.1" 200 None
2026-03-27 12:11:43 [auto1.nl] INFO: Scrape type for LN50164: 0
2026-03-27 12:11:43 [auto1.nl] INFO: Found listing with ID: LB35433
2026-03-27 12:11:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LB35433%27 HTTP/1.1" 200 None
2026-03-27 12:11:43 [auto1.nl] INFO: Scrape type for LB35433: 0
2026-03-27 12:11:43 [auto1.nl] INFO: Found listing with ID: FJ04475
2026-03-27 12:11:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FJ04475%27 HTTP/1.1" 200 None
2026-03-27 12:11:43 [auto1.nl] INFO: Scrape type for FJ04475: 0
2026-03-27 12:11:43 [auto1.nl] INFO: Found listing with ID: TG03602
2026-03-27 12:11:43 [auto1.nl] INFO: Found listing with ID: XB72700
2026-03-27 12:11:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XB72700%27 HTTP/1.1" 200 None
2026-03-27 12:11:43 [auto1.nl] INFO: Scrape type for XB72700: 0
2026-03-27 12:11:43 [auto1.nl] INFO: Found listing with ID: YW78376
2026-03-27 12:11:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YW78376%27 HTTP/1.1" 200 None
2026-03-27 12:11:43 [auto1.nl] INFO: Scrape type for YW78376: 0
2026-03-27 12:11:43 [auto1.nl] INFO: Found listing with ID: DE05424
2026-03-27 12:11:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DE05424%27 HTTP/1.1" 200 None
2026-03-27 12:11:43 [auto1.nl] INFO: Scrape type for DE05424: 0
2026-03-27 12:11:43 [auto1.nl] INFO: Found listing with ID: LT73586
2026-03-27 12:11:43 [auto1.nl] INFO: Found listing with ID: JN17461
2026-03-27 12:11:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JN17461%27 HTTP/1.1" 200 None
2026-03-27 12:11:43 [auto1.nl] INFO: Scrape type for JN17461: 0
2026-03-27 12:11:43 [auto1.nl] INFO: Found listing with ID: EN44222
2026-03-27 12:11:43 [auto1.nl] INFO: Found listing with ID: JR01730
2026-03-27 12:11:43 [auto1.nl] INFO: Found listing with ID: GR72952
2026-03-27 12:11:43 [auto1.nl] INFO: Found listing with ID: FW73564
2026-03-27 12:11:43 [auto1.nl] INFO: Found listing with ID: YT29313
2026-03-27 12:11:43 [auto1.nl] INFO: Found listing with ID: KY62085
2026-03-27 12:11:43 [auto1.nl] INFO: Found listing with ID: GC91066
2026-03-27 12:11:43 [auto1.nl] INFO: Found listing with ID: TP82192
2026-03-27 12:11:43 [auto1.nl] INFO: Found listing with ID: EP01312
2026-03-27 12:11:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EP01312%27 HTTP/1.1" 200 None
2026-03-27 12:11:43 [auto1.nl] INFO: Scrape type for EP01312: 0
2026-03-27 12:11:43 [auto1.nl] INFO: Found listing with ID: XS56409
2026-03-27 12:11:43 [auto1.nl] INFO: Found listing with ID: RW09535
2026-03-27 12:11:43 [auto1.nl] INFO: Found listing with ID: SL71745
2026-03-27 12:11:43 [auto1.nl] INFO: Found listing with ID: HS40359
2026-03-27 12:11:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 12:11:44 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 12:11:44 [auto1.nl] INFO: Channel: 24h | Page: 13 | totalHits: 1060 | hits on page: 40
2026-03-27 12:11:44 [auto1.nl] INFO: Found listing with ID: GW56825
2026-03-27 12:11:44 [auto1.nl] INFO: Found listing with ID: HX62268
2026-03-27 12:11:44 [auto1.nl] INFO: Found listing with ID: ER73656
2026-03-27 12:11:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ER73656%27 HTTP/1.1" 200 None
2026-03-27 12:11:44 [auto1.nl] INFO: Scrape type for ER73656: 0
2026-03-27 12:11:44 [auto1.nl] INFO: Found listing with ID: HM04115
2026-03-27 12:11:44 [auto1.nl] INFO: Found listing with ID: BR90130
2026-03-27 12:11:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BR90130%27 HTTP/1.1" 200 None
2026-03-27 12:11:44 [auto1.nl] INFO: Scrape type for BR90130: 0
2026-03-27 12:11:44 [auto1.nl] INFO: Found listing with ID: DS66279
2026-03-27 12:11:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DS66279%27 HTTP/1.1" 200 None
2026-03-27 12:11:44 [auto1.nl] INFO: Scrape type for DS66279: 0
2026-03-27 12:11:44 [auto1.nl] INFO: Found listing with ID: ED28465
2026-03-27 12:11:44 [auto1.nl] INFO: Found listing with ID: AA50190
2026-03-27 12:11:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AA50190%27 HTTP/1.1" 200 None
2026-03-27 12:11:44 [auto1.nl] INFO: Scrape type for AA50190: 0
2026-03-27 12:11:44 [auto1.nl] INFO: Found listing with ID: DS36560
2026-03-27 12:11:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DS36560%27 HTTP/1.1" 200 None
2026-03-27 12:11:44 [auto1.nl] INFO: Scrape type for DS36560: 0
2026-03-27 12:11:44 [auto1.nl] INFO: Found listing with ID: DW60052
2026-03-27 12:11:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DW60052%27 HTTP/1.1" 200 None
2026-03-27 12:11:44 [auto1.nl] INFO: Scrape type for DW60052: 0
2026-03-27 12:11:44 [auto1.nl] INFO: Found listing with ID: WM74497
2026-03-27 12:11:44 [auto1.nl] INFO: Found listing with ID: GJ53353
2026-03-27 12:11:44 [auto1.nl] INFO: Found listing with ID: NB61734
2026-03-27 12:11:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NB61734%27 HTTP/1.1" 200 None
2026-03-27 12:11:44 [auto1.nl] INFO: Scrape type for NB61734: 0
2026-03-27 12:11:44 [auto1.nl] INFO: Found listing with ID: KK31365
2026-03-27 12:11:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KK31365%27 HTTP/1.1" 200 None
2026-03-27 12:11:44 [auto1.nl] INFO: Scrape type for KK31365: 0
2026-03-27 12:11:44 [auto1.nl] INFO: Found listing with ID: TK52000
2026-03-27 12:11:44 [auto1.nl] INFO: Found listing with ID: UR53095
2026-03-27 12:11:44 [auto1.nl] INFO: Found listing with ID: TR64287
2026-03-27 12:11:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TR64287%27 HTTP/1.1" 200 None
2026-03-27 12:11:44 [auto1.nl] INFO: Scrape type for TR64287: 0
2026-03-27 12:11:44 [auto1.nl] INFO: Found listing with ID: VW91946
2026-03-27 12:11:44 [auto1.nl] INFO: Found listing with ID: JB00487
2026-03-27 12:11:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JB00487%27 HTTP/1.1" 200 None
2026-03-27 12:11:44 [auto1.nl] INFO: Scrape type for JB00487: 0
2026-03-27 12:11:44 [auto1.nl] INFO: Found listing with ID: KK04481
2026-03-27 12:11:44 [auto1.nl] INFO: Found listing with ID: AN01630
2026-03-27 12:11:44 [auto1.nl] INFO: Found listing with ID: PL05358
2026-03-27 12:11:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PL05358%27 HTTP/1.1" 200 None
2026-03-27 12:11:44 [auto1.nl] INFO: Scrape type for PL05358: 0
2026-03-27 12:11:44 [auto1.nl] INFO: Found listing with ID: YH00240
2026-03-27 12:11:44 [auto1.nl] INFO: Found listing with ID: TF74045
2026-03-27 12:11:44 [auto1.nl] INFO: Found listing with ID: LX95579
2026-03-27 12:11:44 [auto1.nl] INFO: Found listing with ID: NX54730
2026-03-27 12:11:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NX54730%27 HTTP/1.1" 200 None
2026-03-27 12:11:44 [auto1.nl] INFO: Scrape type for NX54730: 0
2026-03-27 12:11:44 [auto1.nl] INFO: Found listing with ID: PK96400
2026-03-27 12:11:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PK96400%27 HTTP/1.1" 200 None
2026-03-27 12:11:44 [auto1.nl] INFO: Scrape type for PK96400: 0
2026-03-27 12:11:44 [auto1.nl] INFO: Found listing with ID: PZ22600
2026-03-27 12:11:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PZ22600%27 HTTP/1.1" 200 None
2026-03-27 12:11:44 [auto1.nl] INFO: Scrape type for PZ22600: 0
2026-03-27 12:11:44 [auto1.nl] INFO: Found listing with ID: JX13279
2026-03-27 12:11:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JX13279%27 HTTP/1.1" 200 None
2026-03-27 12:11:44 [auto1.nl] INFO: Scrape type for JX13279: 0
2026-03-27 12:11:44 [auto1.nl] INFO: Found listing with ID: UE20026
2026-03-27 12:11:44 [auto1.nl] INFO: Found listing with ID: NH87974
2026-03-27 12:11:44 [auto1.nl] INFO: Found listing with ID: WF02438
2026-03-27 12:11:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WF02438%27 HTTP/1.1" 200 None
2026-03-27 12:11:44 [auto1.nl] INFO: Scrape type for WF02438: 0
2026-03-27 12:11:44 [auto1.nl] INFO: Found listing with ID: AX44669
2026-03-27 12:11:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AX44669%27 HTTP/1.1" 200 None
2026-03-27 12:11:44 [auto1.nl] INFO: Scrape type for AX44669: 0
2026-03-27 12:11:44 [auto1.nl] INFO: Found listing with ID: TR69611
2026-03-27 12:11:44 [auto1.nl] INFO: Found listing with ID: MF68511
2026-03-27 12:11:44 [auto1.nl] INFO: Found listing with ID: PN34137
2026-03-27 12:11:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PN34137%27 HTTP/1.1" 200 None
2026-03-27 12:11:44 [auto1.nl] INFO: Scrape type for PN34137: 0
2026-03-27 12:11:44 [auto1.nl] INFO: Found listing with ID: RE93496
2026-03-27 12:11:44 [auto1.nl] INFO: Found listing with ID: XV41758
2026-03-27 12:11:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XV41758%27 HTTP/1.1" 200 None
2026-03-27 12:11:44 [auto1.nl] INFO: Scrape type for XV41758: 0
2026-03-27 12:11:44 [auto1.nl] INFO: Found listing with ID: XW63639
2026-03-27 12:11:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XW63639%27 HTTP/1.1" 200 None
2026-03-27 12:11:44 [auto1.nl] INFO: Scrape type for XW63639: 0
2026-03-27 12:11:44 [auto1.nl] INFO: Found listing with ID: YT86124
2026-03-27 12:11:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YT86124%27 HTTP/1.1" 200 None
2026-03-27 12:11:44 [auto1.nl] INFO: Scrape type for YT86124: 0
2026-03-27 12:11:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 12:11:45 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 12:11:45 [auto1.nl] INFO: Channel: 24h | Page: 14 | totalHits: 1060 | hits on page: 40
2026-03-27 12:11:45 [auto1.nl] INFO: Found listing with ID: RU52951
2026-03-27 12:11:45 [auto1.nl] INFO: Found listing with ID: KB97698
2026-03-27 12:11:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KB97698%27 HTTP/1.1" 200 None
2026-03-27 12:11:45 [auto1.nl] INFO: Scrape type for KB97698: 0
2026-03-27 12:11:45 [auto1.nl] INFO: Found listing with ID: RL27027
2026-03-27 12:11:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RL27027%27 HTTP/1.1" 200 None
2026-03-27 12:11:45 [auto1.nl] INFO: Scrape type for RL27027: 2
2026-03-27 12:11:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a9748351-ddf3-5331-b07d-ca52840c09ed with identifier: RL27027
2026-03-27 12:11:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a9748351-ddf3-5331-b07d-ca52840c09ed with scrape type 2
2026-03-27 12:11:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a9748351-ddf3-5331-b07d-ca52840c09ed with scrape type 2
2026-03-27 12:11:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: a9748351-ddf3-5331-b07d-ca52840c09ed, identifier: RL27027
2026-03-27 12:11:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: a9748351-ddf3-5331-b07d-ca52840c09ed with identifier: RL27027
2026-03-27 12:11:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: a9748351-ddf3-5331-b07d-ca52840c09ed with identifier: RL27027
2026-03-27 12:11:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: a9748351-ddf3-5331-b07d-ca52840c09ed with identifier: RL27027 to the API
2026-03-27 12:11:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 12:11:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 12:11:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-27T16:26:34Z',
 'fuel_type': 'petrol',
 'id': 'a9748351-ddf3-5331-b07d-ca52840c09ed',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RL27027',
 'listing': 'auction',
 'make': 'Fiat',
 'model': 'Punto',
 'odometer': 70867,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-08-27',
 'seller_name': None,
 'title': 'Fiat Punto 0.9 Pop',
 'transmission': 'manual',
 'trim': 'Pop',
 'year': 2015}
2026-03-27 12:11:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RL27027%27 HTTP/1.1" 200 None
2026-03-27 12:11:46 [auto1.nl] INFO: Saving data for RL27027: {'auction_closing_time': 1774628794.0, 'created_time': 1774422620.850159, 'last_price_update_time': 1774613506.251848}
2026-03-27 12:11:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='RL27027') HTTP/1.1" 204 0
2026-03-27 12:11:46 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 12:11:46 [auto1.nl] INFO: Found listing with ID: JS69724
2026-03-27 12:11:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JS69724%27 HTTP/1.1" 200 None
2026-03-27 12:11:46 [auto1.nl] INFO: Scrape type for JS69724: 0
2026-03-27 12:11:46 [auto1.nl] INFO: Found listing with ID: TH30413
2026-03-27 12:11:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TH30413%27 HTTP/1.1" 200 None
2026-03-27 12:11:46 [auto1.nl] INFO: Scrape type for TH30413: 0
2026-03-27 12:11:46 [auto1.nl] INFO: Found listing with ID: WP75740
2026-03-27 12:11:46 [auto1.nl] INFO: Found listing with ID: XP30676
2026-03-27 12:11:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XP30676%27 HTTP/1.1" 200 None
2026-03-27 12:11:46 [auto1.nl] INFO: Scrape type for XP30676: 0
2026-03-27 12:11:46 [auto1.nl] INFO: Found listing with ID: NU02129
2026-03-27 12:11:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NU02129%27 HTTP/1.1" 200 None
2026-03-27 12:11:46 [auto1.nl] INFO: Scrape type for NU02129: 0
2026-03-27 12:11:46 [auto1.nl] INFO: Found listing with ID: SX62443
2026-03-27 12:11:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SX62443%27 HTTP/1.1" 200 None
2026-03-27 12:11:46 [auto1.nl] INFO: Scrape type for SX62443: 0
2026-03-27 12:11:46 [auto1.nl] INFO: Found listing with ID: VA53958
2026-03-27 12:11:46 [auto1.nl] INFO: Found listing with ID: AN15968
2026-03-27 12:11:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AN15968%27 HTTP/1.1" 200 None
2026-03-27 12:11:46 [auto1.nl] INFO: Scrape type for AN15968: 0
2026-03-27 12:11:46 [auto1.nl] INFO: Found listing with ID: CV80682
2026-03-27 12:11:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CV80682%27 HTTP/1.1" 200 None
2026-03-27 12:11:46 [auto1.nl] INFO: Scrape type for CV80682: 0
2026-03-27 12:11:46 [auto1.nl] INFO: Found listing with ID: SA56403
2026-03-27 12:11:46 [auto1.nl] INFO: Found listing with ID: ZP53707
2026-03-27 12:11:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZP53707%27 HTTP/1.1" 200 None
2026-03-27 12:11:46 [auto1.nl] INFO: Scrape type for ZP53707: 0
2026-03-27 12:11:46 [auto1.nl] INFO: Found listing with ID: FN85022
2026-03-27 12:11:46 [auto1.nl] INFO: Found listing with ID: WV32142
2026-03-27 12:11:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WV32142%27 HTTP/1.1" 200 None
2026-03-27 12:11:46 [auto1.nl] INFO: Scrape type for WV32142: 0
2026-03-27 12:11:46 [auto1.nl] INFO: Found listing with ID: MR89214
2026-03-27 12:11:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MR89214%27 HTTP/1.1" 200 None
2026-03-27 12:11:46 [auto1.nl] INFO: Scrape type for MR89214: 0
2026-03-27 12:11:46 [auto1.nl] INFO: Found listing with ID: TN86188
2026-03-27 12:11:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TN86188%27 HTTP/1.1" 200 None
2026-03-27 12:11:46 [auto1.nl] INFO: Scrape type for TN86188: 0
2026-03-27 12:11:46 [auto1.nl] INFO: Found listing with ID: MF32327
2026-03-27 12:11:46 [auto1.nl] INFO: Found listing with ID: AN32414
2026-03-27 12:11:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AN32414%27 HTTP/1.1" 200 None
2026-03-27 12:11:46 [auto1.nl] INFO: Scrape type for AN32414: 0
2026-03-27 12:11:46 [auto1.nl] INFO: Found listing with ID: RF97563
2026-03-27 12:11:46 [auto1.nl] INFO: Found listing with ID: CE86050
2026-03-27 12:11:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CE86050%27 HTTP/1.1" 200 None
2026-03-27 12:11:46 [auto1.nl] INFO: Scrape type for CE86050: 0
2026-03-27 12:11:46 [auto1.nl] INFO: Found listing with ID: BE76328
2026-03-27 12:11:46 [auto1.nl] INFO: Found listing with ID: ZY08342
2026-03-27 12:11:46 [auto1.nl] INFO: Found listing with ID: GS89780
2026-03-27 12:11:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GS89780%27 HTTP/1.1" 200 None
2026-03-27 12:11:46 [auto1.nl] INFO: Scrape type for GS89780: 0
2026-03-27 12:11:46 [auto1.nl] INFO: Found listing with ID: TV28211
2026-03-27 12:11:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TV28211%27 HTTP/1.1" 200 None
2026-03-27 12:11:46 [auto1.nl] INFO: Scrape type for TV28211: 0
2026-03-27 12:11:46 [auto1.nl] INFO: Found listing with ID: TT67624
2026-03-27 12:11:46 [auto1.nl] INFO: Found listing with ID: MP73031
2026-03-27 12:11:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MP73031%27 HTTP/1.1" 200 None
2026-03-27 12:11:46 [auto1.nl] INFO: Scrape type for MP73031: 0
2026-03-27 12:11:46 [auto1.nl] INFO: Found listing with ID: GH52378
2026-03-27 12:11:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GH52378%27 HTTP/1.1" 200 None
2026-03-27 12:11:46 [auto1.nl] INFO: Scrape type for GH52378: 0
2026-03-27 12:11:46 [auto1.nl] INFO: Found listing with ID: YR36694
2026-03-27 12:11:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YR36694%27 HTTP/1.1" 200 None
2026-03-27 12:11:46 [auto1.nl] INFO: Scrape type for YR36694: 2
2026-03-27 12:11:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 43ecb4a4-84b2-5b88-a3df-60f3f8b4cf25 with identifier: YR36694
2026-03-27 12:11:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 43ecb4a4-84b2-5b88-a3df-60f3f8b4cf25 with scrape type 2
2026-03-27 12:11:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 43ecb4a4-84b2-5b88-a3df-60f3f8b4cf25 with scrape type 2
2026-03-27 12:11:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 43ecb4a4-84b2-5b88-a3df-60f3f8b4cf25, identifier: YR36694
2026-03-27 12:11:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 43ecb4a4-84b2-5b88-a3df-60f3f8b4cf25 with identifier: YR36694
2026-03-27 12:11:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 43ecb4a4-84b2-5b88-a3df-60f3f8b4cf25 with identifier: YR36694
2026-03-27 12:11:46 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 43ecb4a4-84b2-5b88-a3df-60f3f8b4cf25 with identifier: YR36694 to the API
2026-03-27 12:11:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 12:11:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 12:11:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-27T16:23:08Z',
 'fuel_type': 'hybrid',
 'id': '43ecb4a4-84b2-5b88-a3df-60f3f8b4cf25',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YR36694',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'Corolla',
 'odometer': 134446,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-03-07',
 'seller_name': None,
 'title': 'Toyota Corolla 1.8 Hybrid GR Sport',
 'transmission': 'automatic',
 'trim': 'GR Sport',
 'year': 2021}
2026-03-27 12:11:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YR36694%27 HTTP/1.1" 200 None
2026-03-27 12:11:47 [auto1.nl] INFO: Saving data for YR36694: {'auction_closing_time': 1774628588.0, 'created_time': 1773343171.459321, 'last_price_update_time': 1774613507.083573}
2026-03-27 12:11:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='YR36694') HTTP/1.1" 204 0
2026-03-27 12:11:47 [auto1.nl] INFO: Found listing with ID: RC52062
2026-03-27 12:11:47 [auto1.nl] INFO: Found listing with ID: TW92220
2026-03-27 12:11:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TW92220%27 HTTP/1.1" 200 None
2026-03-27 12:11:47 [auto1.nl] INFO: Scrape type for TW92220: 0
2026-03-27 12:11:47 [auto1.nl] INFO: Found listing with ID: UU65627
2026-03-27 12:11:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UU65627%27 HTTP/1.1" 200 None
2026-03-27 12:11:47 [auto1.nl] INFO: Scrape type for UU65627: 0
2026-03-27 12:11:47 [auto1.nl] INFO: Found listing with ID: UG37918
2026-03-27 12:11:47 [auto1.nl] INFO: Found listing with ID: PU28768
2026-03-27 12:11:47 [auto1.nl] INFO: Found listing with ID: VX18772
2026-03-27 12:11:47 [auto1.nl] INFO: Found listing with ID: UJ17437
2026-03-27 12:11:47 [auto1.nl] INFO: Found listing with ID: XG57923
2026-03-27 12:11:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XG57923%27 HTTP/1.1" 200 None
2026-03-27 12:11:47 [auto1.nl] INFO: Scrape type for XG57923: 0
2026-03-27 12:11:47 [auto1.nl] INFO: Found listing with ID: SD69435
2026-03-27 12:11:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SD69435%27 HTTP/1.1" 200 None
2026-03-27 12:11:47 [auto1.nl] INFO: Scrape type for SD69435: 0
2026-03-27 12:11:47 [auto1.nl] INFO: Found listing with ID: AT24375
2026-03-27 12:11:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AT24375%27 HTTP/1.1" 200 None
2026-03-27 12:11:47 [auto1.nl] INFO: Scrape type for AT24375: 0
2026-03-27 12:11:48 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 12:11:48 [auto1.nl] INFO: Channel: 24h | Page: 15 | totalHits: 1060 | hits on page: 40
2026-03-27 12:11:48 [auto1.nl] INFO: Found listing with ID: SL35603
2026-03-27 12:11:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SL35603%27 HTTP/1.1" 200 None
2026-03-27 12:11:48 [auto1.nl] INFO: Scrape type for SL35603: 2
2026-03-27 12:11:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 31e09490-97b7-5614-a38a-0a1af10d3d68 with identifier: SL35603
2026-03-27 12:11:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 31e09490-97b7-5614-a38a-0a1af10d3d68 with scrape type 2
2026-03-27 12:11:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 31e09490-97b7-5614-a38a-0a1af10d3d68 with scrape type 2
2026-03-27 12:11:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 31e09490-97b7-5614-a38a-0a1af10d3d68, identifier: SL35603
2026-03-27 12:11:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 31e09490-97b7-5614-a38a-0a1af10d3d68 with identifier: SL35603
2026-03-27 12:11:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 31e09490-97b7-5614-a38a-0a1af10d3d68 with identifier: SL35603
2026-03-27 12:11:48 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 31e09490-97b7-5614-a38a-0a1af10d3d68 with identifier: SL35603 to the API
2026-03-27 12:11:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 12:11:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 12:11:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 92,
 'expiration_date': '2026-03-27T16:46:27Z',
 'fuel_type': 'petrol',
 'id': '31e09490-97b7-5614-a38a-0a1af10d3d68',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SL35603',
 'listing': 'auction',
 'make': 'Suzuki',
 'model': 'Swift',
 'odometer': 232169,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-09-16',
 'seller_name': None,
 'title': 'Suzuki Swift 1.3 Club',
 'transmission': 'manual',
 'trim': 'Club',
 'year': 2009}
2026-03-27 12:11:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SL35603%27 HTTP/1.1" 200 None
2026-03-27 12:11:48 [auto1.nl] INFO: Saving data for SL35603: {'auction_closing_time': 1774629987.0, 'created_time': 1774336221.258123, 'last_price_update_time': 1774613508.693107}
2026-03-27 12:11:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='SL35603') HTTP/1.1" 204 0
2026-03-27 12:11:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 12:11:48 [auto1.nl] INFO: Found listing with ID: JY08621
2026-03-27 12:11:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JY08621%27 HTTP/1.1" 200 None
2026-03-27 12:11:48 [auto1.nl] INFO: Scrape type for JY08621: 0
2026-03-27 12:11:48 [auto1.nl] INFO: Found listing with ID: AK29274
2026-03-27 12:11:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AK29274%27 HTTP/1.1" 200 None
2026-03-27 12:11:48 [auto1.nl] INFO: Scrape type for AK29274: 0
2026-03-27 12:11:48 [auto1.nl] INFO: Found listing with ID: EX94963
2026-03-27 12:11:48 [auto1.nl] INFO: Found listing with ID: HH25512
2026-03-27 12:11:48 [auto1.nl] INFO: Found listing with ID: CC64769
2026-03-27 12:11:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CC64769%27 HTTP/1.1" 200 None
2026-03-27 12:11:48 [auto1.nl] INFO: Scrape type for CC64769: 0
2026-03-27 12:11:48 [auto1.nl] INFO: Found listing with ID: AB54016
2026-03-27 12:11:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AB54016%27 HTTP/1.1" 200 None
2026-03-27 12:11:48 [auto1.nl] INFO: Scrape type for AB54016: 0
2026-03-27 12:11:48 [auto1.nl] INFO: Found listing with ID: XG69964
2026-03-27 12:11:48 [auto1.nl] INFO: Found listing with ID: NJ80961
2026-03-27 12:11:48 [auto1.nl] INFO: Found listing with ID: EX49205
2026-03-27 12:11:48 [auto1.nl] INFO: Found listing with ID: FK53895
2026-03-27 12:11:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FK53895%27 HTTP/1.1" 200 None
2026-03-27 12:11:48 [auto1.nl] INFO: Scrape type for FK53895: 0
2026-03-27 12:11:48 [auto1.nl] INFO: Found listing with ID: CZ60443
2026-03-27 12:11:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CZ60443%27 HTTP/1.1" 200 None
2026-03-27 12:11:48 [auto1.nl] INFO: Scrape type for CZ60443: 0
2026-03-27 12:11:48 [auto1.nl] INFO: Found listing with ID: ZG22704
2026-03-27 12:11:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZG22704%27 HTTP/1.1" 200 None
2026-03-27 12:11:48 [auto1.nl] INFO: Scrape type for ZG22704: 0
2026-03-27 12:11:48 [auto1.nl] INFO: Found listing with ID: BF50619
2026-03-27 12:11:48 [auto1.nl] INFO: Found listing with ID: HK41309
2026-03-27 12:11:48 [auto1.nl] INFO: Found listing with ID: SK27305
2026-03-27 12:11:48 [auto1.nl] INFO: Found listing with ID: MY43312
2026-03-27 12:11:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MY43312%27 HTTP/1.1" 200 None
2026-03-27 12:11:48 [auto1.nl] INFO: Scrape type for MY43312: 0
2026-03-27 12:11:48 [auto1.nl] INFO: Found listing with ID: MN03312
2026-03-27 12:11:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MN03312%27 HTTP/1.1" 200 None
2026-03-27 12:11:48 [auto1.nl] INFO: Scrape type for MN03312: 0
2026-03-27 12:11:48 [auto1.nl] INFO: Found listing with ID: RX87837
2026-03-27 12:11:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RX87837%27 HTTP/1.1" 200 None
2026-03-27 12:11:48 [auto1.nl] INFO: Scrape type for RX87837: 0
2026-03-27 12:11:48 [auto1.nl] INFO: Found listing with ID: VX32369
2026-03-27 12:11:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VX32369%27 HTTP/1.1" 200 None
2026-03-27 12:11:48 [auto1.nl] INFO: Scrape type for VX32369: 0
2026-03-27 12:11:48 [auto1.nl] INFO: Found listing with ID: YM03723
2026-03-27 12:11:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YM03723%27 HTTP/1.1" 200 None
2026-03-27 12:11:48 [auto1.nl] INFO: Scrape type for YM03723: 0
2026-03-27 12:11:48 [auto1.nl] INFO: Found listing with ID: NA29712
2026-03-27 12:11:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NA29712%27 HTTP/1.1" 200 None
2026-03-27 12:11:49 [auto1.nl] INFO: Scrape type for NA29712: 0
2026-03-27 12:11:49 [auto1.nl] INFO: Found listing with ID: KM38195
2026-03-27 12:11:49 [auto1.nl] INFO: Found listing with ID: NH92548
2026-03-27 12:11:49 [auto1.nl] INFO: Found listing with ID: TV26065
2026-03-27 12:11:49 [auto1.nl] INFO: Found listing with ID: SU79725
2026-03-27 12:11:49 [auto1.nl] INFO: Found listing with ID: DW65450
2026-03-27 12:11:49 [auto1.nl] INFO: Found listing with ID: CK37627
2026-03-27 12:11:49 [auto1.nl] INFO: Found listing with ID: JM82020
2026-03-27 12:11:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JM82020%27 HTTP/1.1" 200 None
2026-03-27 12:11:49 [auto1.nl] INFO: Scrape type for JM82020: 0
2026-03-27 12:11:49 [auto1.nl] INFO: Found listing with ID: CT01963
2026-03-27 12:11:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CT01963%27 HTTP/1.1" 200 None
2026-03-27 12:11:49 [auto1.nl] INFO: Scrape type for CT01963: 0
2026-03-27 12:11:49 [auto1.nl] INFO: Found listing with ID: MW94986
2026-03-27 12:11:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MW94986%27 HTTP/1.1" 200 None
2026-03-27 12:11:49 [auto1.nl] INFO: Scrape type for MW94986: 0
2026-03-27 12:11:49 [auto1.nl] INFO: Found listing with ID: MC21923
2026-03-27 12:11:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MC21923%27 HTTP/1.1" 200 None
2026-03-27 12:11:49 [auto1.nl] INFO: Scrape type for MC21923: 0
2026-03-27 12:11:49 [auto1.nl] INFO: Found listing with ID: YT16121
2026-03-27 12:11:49 [auto1.nl] INFO: Found listing with ID: PC64486
2026-03-27 12:11:49 [auto1.nl] INFO: Found listing with ID: MB63862
2026-03-27 12:11:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MB63862%27 HTTP/1.1" 200 None
2026-03-27 12:11:49 [auto1.nl] INFO: Scrape type for MB63862: 0
2026-03-27 12:11:49 [auto1.nl] INFO: Found listing with ID: SW41282
2026-03-27 12:11:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SW41282%27 HTTP/1.1" 200 None
2026-03-27 12:11:49 [auto1.nl] INFO: Scrape type for SW41282: 0
2026-03-27 12:11:49 [auto1.nl] INFO: Found listing with ID: KT83574
2026-03-27 12:11:49 [auto1.nl] INFO: Found listing with ID: JF44438
2026-03-27 12:11:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JF44438%27 HTTP/1.1" 200 None
2026-03-27 12:11:49 [auto1.nl] INFO: Scrape type for JF44438: 0
2026-03-27 12:11:49 [auto1.nl] INFO: Found listing with ID: TF02101
2026-03-27 12:11:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TF02101%27 HTTP/1.1" 200 None
2026-03-27 12:11:49 [auto1.nl] INFO: Scrape type for TF02101: 0
2026-03-27 12:11:49 [auto1.nl] INFO: Found listing with ID: PJ78328
2026-03-27 12:11:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PJ78328%27 HTTP/1.1" 200 None
2026-03-27 12:11:49 [auto1.nl] INFO: Scrape type for PJ78328: 0
2026-03-27 12:11:50 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 12:11:50 [auto1.nl] INFO: Channel: 24h | Page: 16 | totalHits: 1060 | hits on page: 40
2026-03-27 12:11:50 [auto1.nl] INFO: Found listing with ID: AT39158
2026-03-27 12:11:50 [auto1.nl] INFO: Found listing with ID: UC11957
2026-03-27 12:11:50 [auto1.nl] INFO: Found listing with ID: UP56929
2026-03-27 12:11:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UP56929%27 HTTP/1.1" 200 None
2026-03-27 12:11:50 [auto1.nl] INFO: Scrape type for UP56929: 0
2026-03-27 12:11:50 [auto1.nl] INFO: Found listing with ID: XA55617
2026-03-27 12:11:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XA55617%27 HTTP/1.1" 200 None
2026-03-27 12:11:50 [auto1.nl] INFO: Scrape type for XA55617: 0
2026-03-27 12:11:50 [auto1.nl] INFO: Found listing with ID: UP97235
2026-03-27 12:11:50 [auto1.nl] INFO: Found listing with ID: VN23813
2026-03-27 12:11:50 [auto1.nl] INFO: Found listing with ID: XP09088
2026-03-27 12:11:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XP09088%27 HTTP/1.1" 200 None
2026-03-27 12:11:50 [auto1.nl] INFO: Scrape type for XP09088: 0
2026-03-27 12:11:50 [auto1.nl] INFO: Found listing with ID: YS68012
2026-03-27 12:11:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YS68012%27 HTTP/1.1" 200 None
2026-03-27 12:11:50 [auto1.nl] INFO: Scrape type for YS68012: 0
2026-03-27 12:11:50 [auto1.nl] INFO: Found listing with ID: VE84801
2026-03-27 12:11:50 [auto1.nl] INFO: Found listing with ID: MD18353
2026-03-27 12:11:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MD18353%27 HTTP/1.1" 200 None
2026-03-27 12:11:50 [auto1.nl] INFO: Scrape type for MD18353: 0
2026-03-27 12:11:50 [auto1.nl] INFO: Found listing with ID: NU05681
2026-03-27 12:11:50 [auto1.nl] INFO: Found listing with ID: LN29511
2026-03-27 12:11:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LN29511%27 HTTP/1.1" 200 None
2026-03-27 12:11:50 [auto1.nl] INFO: Scrape type for LN29511: 0
2026-03-27 12:11:50 [auto1.nl] INFO: Found listing with ID: UU42921
2026-03-27 12:11:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UU42921%27 HTTP/1.1" 200 None
2026-03-27 12:11:50 [auto1.nl] INFO: Scrape type for UU42921: 0
2026-03-27 12:11:50 [auto1.nl] INFO: Found listing with ID: UE74675
2026-03-27 12:11:50 [auto1.nl] INFO: Found listing with ID: WP97111
2026-03-27 12:11:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WP97111%27 HTTP/1.1" 200 None
2026-03-27 12:11:50 [auto1.nl] INFO: Scrape type for WP97111: 0
2026-03-27 12:11:50 [auto1.nl] INFO: Found listing with ID: EE19429
2026-03-27 12:11:50 [auto1.nl] INFO: Found listing with ID: VS32339
2026-03-27 12:11:50 [auto1.nl] INFO: Found listing with ID: UR39080
2026-03-27 12:11:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UR39080%27 HTTP/1.1" 200 None
2026-03-27 12:11:50 [auto1.nl] INFO: Scrape type for UR39080: 0
2026-03-27 12:11:50 [auto1.nl] INFO: Found listing with ID: LH67432
2026-03-27 12:11:50 [auto1.nl] INFO: Found listing with ID: WE20497
2026-03-27 12:11:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WE20497%27 HTTP/1.1" 200 None
2026-03-27 12:11:50 [auto1.nl] INFO: Scrape type for WE20497: 0
2026-03-27 12:11:50 [auto1.nl] INFO: Found listing with ID: BE07790
2026-03-27 12:11:50 [auto1.nl] INFO: Found listing with ID: HL29308
2026-03-27 12:11:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HL29308%27 HTTP/1.1" 200 None
2026-03-27 12:11:50 [auto1.nl] INFO: Scrape type for HL29308: 0
2026-03-27 12:11:50 [auto1.nl] INFO: Found listing with ID: ZB66825
2026-03-27 12:11:50 [auto1.nl] INFO: Found listing with ID: JS13271
2026-03-27 12:11:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JS13271%27 HTTP/1.1" 200 None
2026-03-27 12:11:50 [auto1.nl] INFO: Scrape type for JS13271: 0
2026-03-27 12:11:50 [auto1.nl] INFO: Found listing with ID: TJ79570
2026-03-27 12:11:50 [auto1.nl] INFO: Found listing with ID: UC71604
2026-03-27 12:11:50 [auto1.nl] INFO: Found listing with ID: XZ67857
2026-03-27 12:11:50 [auto1.nl] INFO: Found listing with ID: DM27085
2026-03-27 12:11:50 [auto1.nl] INFO: Found listing with ID: CP13228
2026-03-27 12:11:50 [auto1.nl] INFO: Found listing with ID: UK83589
2026-03-27 12:11:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UK83589%27 HTTP/1.1" 200 None
2026-03-27 12:11:50 [auto1.nl] INFO: Scrape type for UK83589: 0
2026-03-27 12:11:50 [auto1.nl] INFO: Found listing with ID: ZN91004
2026-03-27 12:11:50 [auto1.nl] INFO: Found listing with ID: KC58229
2026-03-27 12:11:50 [auto1.nl] INFO: Found listing with ID: EP42288
2026-03-27 12:11:50 [auto1.nl] INFO: Found listing with ID: SV22274
2026-03-27 12:11:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SV22274%27 HTTP/1.1" 200 None
2026-03-27 12:11:50 [auto1.nl] INFO: Scrape type for SV22274: 0
2026-03-27 12:11:50 [auto1.nl] INFO: Found listing with ID: NX17950
2026-03-27 12:11:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NX17950%27 HTTP/1.1" 200 None
2026-03-27 12:11:50 [auto1.nl] INFO: Scrape type for NX17950: 0
2026-03-27 12:11:50 [auto1.nl] INFO: Found listing with ID: WA98443
2026-03-27 12:11:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WA98443%27 HTTP/1.1" 200 None
2026-03-27 12:11:50 [auto1.nl] INFO: Scrape type for WA98443: 0
2026-03-27 12:11:50 [auto1.nl] INFO: Found listing with ID: NT56594
2026-03-27 12:11:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NT56594%27 HTTP/1.1" 200 None
2026-03-27 12:11:50 [auto1.nl] INFO: Scrape type for NT56594: 0
2026-03-27 12:11:50 [auto1.nl] INFO: Found listing with ID: UR86175
2026-03-27 12:11:50 [auto1.nl] INFO: Found listing with ID: VR96830
2026-03-27 12:11:50 [auto1.nl] INFO: Found listing with ID: TJ11018
2026-03-27 12:11:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TJ11018%27 HTTP/1.1" 200 None
2026-03-27 12:11:50 [auto1.nl] INFO: Scrape type for TJ11018: 0
2026-03-27 12:11:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 12:11:51 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 12:11:51 [auto1.nl] INFO: Channel: 24h | Page: 17 | totalHits: 1060 | hits on page: 40
2026-03-27 12:11:51 [auto1.nl] INFO: Found listing with ID: DF40523
2026-03-27 12:11:51 [auto1.nl] INFO: Found listing with ID: MY36712
2026-03-27 12:11:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MY36712%27 HTTP/1.1" 200 None
2026-03-27 12:11:51 [auto1.nl] INFO: Scrape type for MY36712: 0
2026-03-27 12:11:51 [auto1.nl] INFO: Found listing with ID: LZ72966
2026-03-27 12:11:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LZ72966%27 HTTP/1.1" 200 None
2026-03-27 12:11:51 [auto1.nl] INFO: Scrape type for LZ72966: 0
2026-03-27 12:11:51 [auto1.nl] INFO: Found listing with ID: HY67553
2026-03-27 12:11:51 [auto1.nl] INFO: Found listing with ID: FP10265
2026-03-27 12:11:51 [auto1.nl] INFO: Found listing with ID: CL26046
2026-03-27 12:11:51 [auto1.nl] INFO: Found listing with ID: ZR90330
2026-03-27 12:11:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZR90330%27 HTTP/1.1" 200 None
2026-03-27 12:11:51 [auto1.nl] INFO: Scrape type for ZR90330: 0
2026-03-27 12:11:51 [auto1.nl] INFO: Found listing with ID: CV76653
2026-03-27 12:11:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CV76653%27 HTTP/1.1" 200 None
2026-03-27 12:11:51 [auto1.nl] INFO: Scrape type for CV76653: 0
2026-03-27 12:11:51 [auto1.nl] INFO: Found listing with ID: UC87539
2026-03-27 12:11:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UC87539%27 HTTP/1.1" 200 None
2026-03-27 12:11:51 [auto1.nl] INFO: Scrape type for UC87539: 0
2026-03-27 12:11:51 [auto1.nl] INFO: Found listing with ID: BH47891
2026-03-27 12:11:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BH47891%27 HTTP/1.1" 200 None
2026-03-27 12:11:51 [auto1.nl] INFO: Scrape type for BH47891: 0
2026-03-27 12:11:51 [auto1.nl] INFO: Found listing with ID: BL93572
2026-03-27 12:11:51 [auto1.nl] INFO: Found listing with ID: EH64437
2026-03-27 12:11:51 [auto1.nl] INFO: Found listing with ID: RP05834
2026-03-27 12:11:51 [auto1.nl] INFO: Found listing with ID: VF41372
2026-03-27 12:11:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VF41372%27 HTTP/1.1" 200 None
2026-03-27 12:11:51 [auto1.nl] INFO: Scrape type for VF41372: 0
2026-03-27 12:11:51 [auto1.nl] INFO: Found listing with ID: ZY63395
2026-03-27 12:11:51 [auto1.nl] INFO: Found listing with ID: LF83736
2026-03-27 12:11:51 [auto1.nl] INFO: Found listing with ID: JZ14599
2026-03-27 12:11:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JZ14599%27 HTTP/1.1" 200 None
2026-03-27 12:11:51 [auto1.nl] INFO: Scrape type for JZ14599: 0
2026-03-27 12:11:51 [auto1.nl] INFO: Found listing with ID: GV22428
2026-03-27 12:11:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GV22428%27 HTTP/1.1" 200 None
2026-03-27 12:11:51 [auto1.nl] INFO: Scrape type for GV22428: 0
2026-03-27 12:11:51 [auto1.nl] INFO: Found listing with ID: MU78869
2026-03-27 12:11:51 [auto1.nl] INFO: Found listing with ID: AE96402
2026-03-27 12:11:51 [auto1.nl] INFO: Found listing with ID: LU39943
2026-03-27 12:11:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LU39943%27 HTTP/1.1" 200 None
2026-03-27 12:11:51 [auto1.nl] INFO: Scrape type for LU39943: 0
2026-03-27 12:11:51 [auto1.nl] INFO: Found listing with ID: KC46486
2026-03-27 12:11:51 [auto1.nl] INFO: Found listing with ID: XC02971
2026-03-27 12:11:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XC02971%27 HTTP/1.1" 200 None
2026-03-27 12:11:51 [auto1.nl] INFO: Scrape type for XC02971: 0
2026-03-27 12:11:51 [auto1.nl] INFO: Found listing with ID: LE34975
2026-03-27 12:11:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LE34975%27 HTTP/1.1" 200 None
2026-03-27 12:11:51 [auto1.nl] INFO: Scrape type for LE34975: 0
2026-03-27 12:11:51 [auto1.nl] INFO: Found listing with ID: SX35832
2026-03-27 12:11:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SX35832%27 HTTP/1.1" 200 None
2026-03-27 12:11:51 [auto1.nl] INFO: Scrape type for SX35832: 0
2026-03-27 12:11:51 [auto1.nl] INFO: Found listing with ID: FH99485
2026-03-27 12:11:51 [auto1.nl] INFO: Found listing with ID: EP67641
2026-03-27 12:11:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EP67641%27 HTTP/1.1" 200 None
2026-03-27 12:11:51 [auto1.nl] INFO: Scrape type for EP67641: 0
2026-03-27 12:11:51 [auto1.nl] INFO: Found listing with ID: YA36223
2026-03-27 12:11:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YA36223%27 HTTP/1.1" 200 None
2026-03-27 12:11:51 [auto1.nl] INFO: Scrape type for YA36223: 0
2026-03-27 12:11:51 [auto1.nl] INFO: Found listing with ID: PD16289
2026-03-27 12:11:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PD16289%27 HTTP/1.1" 200 None
2026-03-27 12:11:51 [auto1.nl] INFO: Scrape type for PD16289: 0
2026-03-27 12:11:51 [auto1.nl] INFO: Found listing with ID: YL08691
2026-03-27 12:11:51 [auto1.nl] INFO: Found listing with ID: HY06013
2026-03-27 12:11:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HY06013%27 HTTP/1.1" 200 None
2026-03-27 12:11:51 [auto1.nl] INFO: Scrape type for HY06013: 0
2026-03-27 12:11:51 [auto1.nl] INFO: Found listing with ID: ST98483
2026-03-27 12:11:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:11:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ST98483%27 HTTP/1.1" 200 None
2026-03-27 12:11:51 [auto1.nl] INFO: Scrape type for ST98483: 0
2026-03-27 12:11:51 [auto1.nl] INFO: Found listing with ID: VG54194
2026-03-27 12:11:51 [auto1.nl] INFO: Found listing with ID: SN92784
2026-03-27 12:11:51 [auto1.nl] INFO: Found listing with ID: XC64033
2026-03-27 12:11:51 [auto1.nl] INFO: Found listing with ID: FA42645
2026-03-27 12:11:51 [auto1.nl] INFO: Found listing with ID: KZ79748
2026-03-27 12:11:51 [auto1.nl] INFO: Found listing with ID: TW17403
2026-03-27 12:11:51 [auto1.nl] INFO: Found listing with ID: FF88979
2026-03-27 12:11:51 [auto1.nl] INFO: Found listing with ID: YK25571
2026-03-27 12:11:51 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 12:12:00 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 12:12:00 [auto1.nl] INFO: Channel: 24h | Page: 18 | totalHits: 1060 | hits on page: 40
2026-03-27 12:12:00 [auto1.nl] INFO: Found listing with ID: BG13282
2026-03-27 12:12:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:12:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BG13282%27 HTTP/1.1" 200 None
2026-03-27 12:12:00 [auto1.nl] INFO: Scrape type for BG13282: 0
2026-03-27 12:12:00 [auto1.nl] INFO: Found listing with ID: CK48888
2026-03-27 12:12:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:12:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CK48888%27 HTTP/1.1" 200 None
2026-03-27 12:12:00 [auto1.nl] INFO: Scrape type for CK48888: 0
2026-03-27 12:12:00 [auto1.nl] INFO: Found listing with ID: BD37870
2026-03-27 12:12:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:12:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BD37870%27 HTTP/1.1" 200 None
2026-03-27 12:12:00 [auto1.nl] INFO: Scrape type for BD37870: 0
2026-03-27 12:12:00 [auto1.nl] INFO: Found listing with ID: MW65068
2026-03-27 12:12:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:12:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MW65068%27 HTTP/1.1" 200 None
2026-03-27 12:12:00 [auto1.nl] INFO: Scrape type for MW65068: 0
2026-03-27 12:12:00 [auto1.nl] INFO: Found listing with ID: CY41827
2026-03-27 12:12:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:12:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CY41827%27 HTTP/1.1" 200 None
2026-03-27 12:12:00 [auto1.nl] INFO: Scrape type for CY41827: 0
2026-03-27 12:12:00 [auto1.nl] INFO: Found listing with ID: CT83771
2026-03-27 12:12:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:12:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CT83771%27 HTTP/1.1" 200 None
2026-03-27 12:12:00 [auto1.nl] INFO: Scrape type for CT83771: 2
2026-03-27 12:12:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 998ce902-3fc2-5b63-827f-b2632eb5ef91 with identifier: CT83771
2026-03-27 12:12:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 998ce902-3fc2-5b63-827f-b2632eb5ef91 with scrape type 2
2026-03-27 12:12:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 998ce902-3fc2-5b63-827f-b2632eb5ef91 with scrape type 2
2026-03-27 12:12:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 998ce902-3fc2-5b63-827f-b2632eb5ef91, identifier: CT83771
2026-03-27 12:12:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 998ce902-3fc2-5b63-827f-b2632eb5ef91 with identifier: CT83771
2026-03-27 12:12:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 998ce902-3fc2-5b63-827f-b2632eb5ef91 with identifier: CT83771
2026-03-27 12:12:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 998ce902-3fc2-5b63-827f-b2632eb5ef91 with identifier: CT83771 to the API
2026-03-27 12:12:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 12:12:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 12:12:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 180,
 'expiration_date': '2026-03-27T16:01:58Z',
 'fuel_type': 'petrol',
 'id': '998ce902-3fc2-5b63-827f-b2632eb5ef91',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CT83771',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'Q5',
 'odometer': 105804,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-03-04',
 'seller_name': None,
 'title': 'Audi Q5 2.0 TFSI quattro',
 'transmission': 'manual',
 'trim': 'quattro',
 'year': 2010}
2026-03-27 12:12:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:12:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CT83771%27 HTTP/1.1" 200 None
2026-03-27 12:12:01 [auto1.nl] INFO: Saving data for CT83771: {'auction_closing_time': 1774627318.0, 'created_time': 1774422621.780631, 'last_price_update_time': 1774613521.529387}
2026-03-27 12:12:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:12:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='CT83771') HTTP/1.1" 204 0
2026-03-27 12:12:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 12:12:01 [auto1.nl] INFO: Found listing with ID: AS22669
2026-03-27 12:12:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:12:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AS22669%27 HTTP/1.1" 200 None
2026-03-27 12:12:01 [auto1.nl] INFO: Scrape type for AS22669: 2
2026-03-27 12:12:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f0e2ca48-0a1e-530f-8ee6-f021354e9427 with identifier: AS22669
2026-03-27 12:12:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f0e2ca48-0a1e-530f-8ee6-f021354e9427 with scrape type 2
2026-03-27 12:12:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f0e2ca48-0a1e-530f-8ee6-f021354e9427 with scrape type 2
2026-03-27 12:12:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: f0e2ca48-0a1e-530f-8ee6-f021354e9427, identifier: AS22669
2026-03-27 12:12:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: f0e2ca48-0a1e-530f-8ee6-f021354e9427 with identifier: AS22669
2026-03-27 12:12:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: f0e2ca48-0a1e-530f-8ee6-f021354e9427 with identifier: AS22669
2026-03-27 12:12:01 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: f0e2ca48-0a1e-530f-8ee6-f021354e9427 with identifier: AS22669 to the API
2026-03-27 12:12:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 12:12:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 12:12:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 115,
 'expiration_date': '2026-03-27T16:54:51Z',
 'fuel_type': 'petrol',
 'id': 'f0e2ca48-0a1e-530f-8ee6-f021354e9427',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AS22669',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Insignia Sports Tourer',
 'odometer': 232169,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-04-12',
 'seller_name': None,
 'title': 'Opel Insignia Sports Tourer 1.6 Edition',
 'transmission': 'manual',
 'trim': 'Edition',
 'year': 2011}
2026-03-27 12:12:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:12:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AS22669%27 HTTP/1.1" 200 None
2026-03-27 12:12:02 [auto1.nl] INFO: Saving data for AS22669: {'auction_closing_time': 1774630491.0, 'created_time': 1773861128.719525, 'last_price_update_time': 1774613522.087439}
2026-03-27 12:12:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:12:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='AS22669') HTTP/1.1" 204 0
2026-03-27 12:12:02 [auto1.nl] INFO: Found listing with ID: YF39374
2026-03-27 12:12:02 [auto1.nl] INFO: Found listing with ID: AN73809
2026-03-27 12:12:02 [auto1.nl] INFO: Found listing with ID: CA14360
2026-03-27 12:12:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:12:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CA14360%27 HTTP/1.1" 200 None
2026-03-27 12:12:02 [auto1.nl] INFO: Scrape type for CA14360: 0
2026-03-27 12:12:02 [auto1.nl] INFO: Found listing with ID: HW54895
2026-03-27 12:12:02 [auto1.nl] INFO: Found listing with ID: GV74945
2026-03-27 12:12:02 [auto1.nl] INFO: Found listing with ID: VC25009
2026-03-27 12:12:02 [auto1.nl] INFO: Found listing with ID: PL67988
2026-03-27 12:12:02 [auto1.nl] INFO: Found listing with ID: NG59138
2026-03-27 12:12:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:12:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NG59138%27 HTTP/1.1" 200 None
2026-03-27 12:12:02 [auto1.nl] INFO: Scrape type for NG59138: 0
2026-03-27 12:12:02 [auto1.nl] INFO: Found listing with ID: ZK25360
2026-03-27 12:12:02 [auto1.nl] INFO: Found listing with ID: HC35521
2026-03-27 12:12:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:12:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HC35521%27 HTTP/1.1" 200 None
2026-03-27 12:12:02 [auto1.nl] INFO: Scrape type for HC35521: 0
2026-03-27 12:12:02 [auto1.nl] INFO: Found listing with ID: UY66824
2026-03-27 12:12:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:12:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UY66824%27 HTTP/1.1" 200 None
2026-03-27 12:12:02 [auto1.nl] INFO: Scrape type for UY66824: 0
2026-03-27 12:12:02 [auto1.nl] INFO: Found listing with ID: NR57871
2026-03-27 12:12:02 [auto1.nl] INFO: Found listing with ID: CU47397
2026-03-27 12:12:02 [auto1.nl] INFO: Found listing with ID: LJ77908
2026-03-27 12:12:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:12:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LJ77908%27 HTTP/1.1" 200 None
2026-03-27 12:12:02 [auto1.nl] INFO: Scrape type for LJ77908: 0
2026-03-27 12:12:02 [auto1.nl] INFO: Found listing with ID: BL89669
2026-03-27 12:12:02 [auto1.nl] INFO: Found listing with ID: FM53893
2026-03-27 12:12:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:12:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FM53893%27 HTTP/1.1" 200 None
2026-03-27 12:12:02 [auto1.nl] INFO: Scrape type for FM53893: 0
2026-03-27 12:12:02 [auto1.nl] INFO: Found listing with ID: AM68781
2026-03-27 12:12:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:12:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AM68781%27 HTTP/1.1" 200 None
2026-03-27 12:12:02 [auto1.nl] INFO: Scrape type for AM68781: 0
2026-03-27 12:12:02 [auto1.nl] INFO: Found listing with ID: MP21260
2026-03-27 12:12:02 [auto1.nl] INFO: Found listing with ID: YW44964
2026-03-27 12:12:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:12:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YW44964%27 HTTP/1.1" 200 None
2026-03-27 12:12:02 [auto1.nl] INFO: Scrape type for YW44964: 0
2026-03-27 12:12:02 [auto1.nl] INFO: Found listing with ID: UT70360
2026-03-27 12:12:02 [auto1.nl] INFO: Found listing with ID: ZR40703
2026-03-27 12:12:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:12:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZR40703%27 HTTP/1.1" 200 None
2026-03-27 12:12:02 [auto1.nl] INFO: Scrape type for ZR40703: 0
2026-03-27 12:12:02 [auto1.nl] INFO: Found listing with ID: DT43342
2026-03-27 12:12:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:12:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DT43342%27 HTTP/1.1" 200 None
2026-03-27 12:12:02 [auto1.nl] INFO: Scrape type for DT43342: 0
2026-03-27 12:12:02 [auto1.nl] INFO: Found listing with ID: TB11511
2026-03-27 12:12:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:12:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TB11511%27 HTTP/1.1" 200 None
2026-03-27 12:12:02 [auto1.nl] INFO: Scrape type for TB11511: 0
2026-03-27 12:12:02 [auto1.nl] INFO: Found listing with ID: CN24822
2026-03-27 12:12:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:12:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CN24822%27 HTTP/1.1" 200 None
2026-03-27 12:12:02 [auto1.nl] INFO: Scrape type for CN24822: 0
2026-03-27 12:12:02 [auto1.nl] INFO: Found listing with ID: VJ51527
2026-03-27 12:12:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:12:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VJ51527%27 HTTP/1.1" 200 None
2026-03-27 12:12:02 [auto1.nl] INFO: Scrape type for VJ51527: 0
2026-03-27 12:12:02 [auto1.nl] INFO: Found listing with ID: PZ78112
2026-03-27 12:12:02 [auto1.nl] INFO: Found listing with ID: YU59495
2026-03-27 12:12:02 [auto1.nl] INFO: Found listing with ID: BC80219
2026-03-27 12:12:02 [auto1.nl] INFO: Found listing with ID: CU35423
2026-03-27 12:12:02 [auto1.nl] INFO: Found listing with ID: CN55991
2026-03-27 12:12:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:12:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CN55991%27 HTTP/1.1" 200 None
2026-03-27 12:12:02 [auto1.nl] INFO: Scrape type for CN55991: 0
2026-03-27 12:12:02 [auto1.nl] INFO: Found listing with ID: BY33770
2026-03-27 12:12:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:12:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BY33770%27 HTTP/1.1" 200 None
2026-03-27 12:12:02 [auto1.nl] INFO: Scrape type for BY33770: 0
2026-03-27 12:12:02 [auto1.nl] INFO: Found listing with ID: FH88416
2026-03-27 12:12:02 [auto1.nl] INFO: Found listing with ID: ZY75007
2026-03-27 12:12:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:12:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZY75007%27 HTTP/1.1" 200 None
2026-03-27 12:12:02 [auto1.nl] INFO: Scrape type for ZY75007: 0
2026-03-27 12:12:04 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 12:12:04 [auto1.nl] INFO: Channel: 24h | Page: 19 | totalHits: 1060 | hits on page: 40
2026-03-27 12:12:04 [auto1.nl] INFO: Found listing with ID: PY50820
2026-03-27 12:12:04 [auto1.nl] INFO: Found listing with ID: MD48743
2026-03-27 12:12:04 [auto1.nl] INFO: Found listing with ID: KL60088
2026-03-27 12:12:04 [auto1.nl] INFO: Found listing with ID: RJ98603
2026-03-27 12:12:04 [auto1.nl] INFO: Found listing with ID: AM83604
2026-03-27 12:12:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:12:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AM83604%27 HTTP/1.1" 200 None
2026-03-27 12:12:04 [auto1.nl] INFO: Scrape type for AM83604: 0
2026-03-27 12:12:04 [auto1.nl] INFO: Found listing with ID: ZP65922
2026-03-27 12:12:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:12:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZP65922%27 HTTP/1.1" 200 None
2026-03-27 12:12:04 [auto1.nl] INFO: Scrape type for ZP65922: 0
2026-03-27 12:12:04 [auto1.nl] INFO: Found listing with ID: AH61195
2026-03-27 12:12:04 [auto1.nl] INFO: Found listing with ID: GE04989
2026-03-27 12:12:04 [auto1.nl] INFO: Found listing with ID: NG66061
2026-03-27 12:12:04 [auto1.nl] INFO: Found listing with ID: SG65266
2026-03-27 12:12:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:12:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SG65266%27 HTTP/1.1" 200 None
2026-03-27 12:12:04 [auto1.nl] INFO: Scrape type for SG65266: 0
2026-03-27 12:12:04 [auto1.nl] INFO: Found listing with ID: MW87847
2026-03-27 12:12:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:12:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MW87847%27 HTTP/1.1" 200 None
2026-03-27 12:12:04 [auto1.nl] INFO: Scrape type for MW87847: 0
2026-03-27 12:12:04 [auto1.nl] INFO: Found listing with ID: EA98995
2026-03-27 12:12:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:12:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EA98995%27 HTTP/1.1" 200 None
2026-03-27 12:12:04 [auto1.nl] INFO: Scrape type for EA98995: 0
2026-03-27 12:12:04 [auto1.nl] INFO: Found listing with ID: FL02627
2026-03-27 12:12:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:12:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FL02627%27 HTTP/1.1" 200 None
2026-03-27 12:12:04 [auto1.nl] INFO: Scrape type for FL02627: 0
2026-03-27 12:12:04 [auto1.nl] INFO: Found listing with ID: PB45464
2026-03-27 12:12:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:12:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PB45464%27 HTTP/1.1" 200 None
2026-03-27 12:12:04 [auto1.nl] INFO: Scrape type for PB45464: 0
2026-03-27 12:12:04 [auto1.nl] INFO: Found listing with ID: AL58798
2026-03-27 12:12:04 [auto1.nl] INFO: Found listing with ID: GK27630
2026-03-27 12:12:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:12:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GK27630%27 HTTP/1.1" 200 None
2026-03-27 12:12:04 [auto1.nl] INFO: Scrape type for GK27630: 0
2026-03-27 12:12:04 [auto1.nl] INFO: Found listing with ID: KF20640
2026-03-27 12:12:04 [auto1.nl] INFO: Found listing with ID: MW44280
2026-03-27 12:12:04 [auto1.nl] INFO: Found listing with ID: JL94248
2026-03-27 12:12:04 [auto1.nl] INFO: Found listing with ID: JU97585
2026-03-27 12:12:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:12:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JU97585%27 HTTP/1.1" 200 None
2026-03-27 12:12:04 [auto1.nl] INFO: Scrape type for JU97585: 0
2026-03-27 12:12:04 [auto1.nl] INFO: Found listing with ID: ED96243
2026-03-27 12:12:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:12:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ED96243%27 HTTP/1.1" 200 None
2026-03-27 12:12:04 [auto1.nl] INFO: Scrape type for ED96243: 0
2026-03-27 12:12:04 [auto1.nl] INFO: Found listing with ID: RT75688
2026-03-27 12:12:04 [auto1.nl] INFO: Found listing with ID: JD50530
2026-03-27 12:12:04 [auto1.nl] INFO: Found listing with ID: YV60983
2026-03-27 12:12:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:12:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YV60983%27 HTTP/1.1" 200 None
2026-03-27 12:12:04 [auto1.nl] INFO: Scrape type for YV60983: 0
2026-03-27 12:12:04 [auto1.nl] INFO: Found listing with ID: FS78045
2026-03-27 12:12:04 [auto1.nl] INFO: Found listing with ID: RY08414
2026-03-27 12:12:04 [auto1.nl] INFO: Found listing with ID: AE75222
2026-03-27 12:12:04 [auto1.nl] INFO: Found listing with ID: DU10654
2026-03-27 12:12:04 [auto1.nl] INFO: Found listing with ID: WL86252
2026-03-27 12:12:04 [auto1.nl] INFO: Found listing with ID: EV31817
2026-03-27 12:12:04 [auto1.nl] INFO: Found listing with ID: RG75877
2026-03-27 12:12:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:12:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RG75877%27 HTTP/1.1" 200 None
2026-03-27 12:12:04 [auto1.nl] INFO: Scrape type for RG75877: 0
2026-03-27 12:12:04 [auto1.nl] INFO: Found listing with ID: ZP63684
2026-03-27 12:12:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:12:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZP63684%27 HTTP/1.1" 200 None
2026-03-27 12:12:04 [auto1.nl] INFO: Scrape type for ZP63684: 0
2026-03-27 12:12:04 [auto1.nl] INFO: Found listing with ID: DH82187
2026-03-27 12:12:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:12:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DH82187%27 HTTP/1.1" 200 None
2026-03-27 12:12:04 [auto1.nl] INFO: Scrape type for DH82187: 0
2026-03-27 12:12:04 [auto1.nl] INFO: Found listing with ID: ZG42486
2026-03-27 12:12:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:12:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZG42486%27 HTTP/1.1" 200 None
2026-03-27 12:12:04 [auto1.nl] INFO: Scrape type for ZG42486: 0
2026-03-27 12:12:04 [auto1.nl] INFO: Found listing with ID: FV20324
2026-03-27 12:12:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:12:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FV20324%27 HTTP/1.1" 200 None
2026-03-27 12:12:04 [auto1.nl] INFO: Scrape type for FV20324: 0
2026-03-27 12:12:04 [auto1.nl] INFO: Found listing with ID: SY61768
2026-03-27 12:12:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:12:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SY61768%27 HTTP/1.1" 200 None
2026-03-27 12:12:04 [auto1.nl] INFO: Scrape type for SY61768: 0
2026-03-27 12:12:04 [auto1.nl] INFO: Found listing with ID: GD44915
2026-03-27 12:12:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:12:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GD44915%27 HTTP/1.1" 200 None
2026-03-27 12:12:04 [auto1.nl] INFO: Scrape type for GD44915: 0
2026-03-27 12:12:04 [auto1.nl] INFO: Found listing with ID: YE49757
2026-03-27 12:12:04 [auto1.nl] INFO: Found listing with ID: US07368
2026-03-27 12:12:04 [auto1.nl] INFO: Found listing with ID: LW17731
2026-03-27 12:12:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 12:12:05 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 12:12:05 [auto1.nl] INFO: Channel: 24h | Page: 20 | totalHits: 1060 | hits on page: 40
2026-03-27 12:12:05 [auto1.nl] INFO: Found listing with ID: GM35453
2026-03-27 12:12:05 [auto1.nl] INFO: Found listing with ID: RA55443
2026-03-27 12:12:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:12:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RA55443%27 HTTP/1.1" 200 None
2026-03-27 12:12:05 [auto1.nl] INFO: Scrape type for RA55443: 0
2026-03-27 12:12:05 [auto1.nl] INFO: Found listing with ID: JW20864
2026-03-27 12:12:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:12:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JW20864%27 HTTP/1.1" 200 None
2026-03-27 12:12:05 [auto1.nl] INFO: Scrape type for JW20864: 0
2026-03-27 12:12:05 [auto1.nl] INFO: Found listing with ID: RH60258
2026-03-27 12:12:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:12:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RH60258%27 HTTP/1.1" 200 None
2026-03-27 12:12:05 [auto1.nl] INFO: Scrape type for RH60258: 0
2026-03-27 12:12:05 [auto1.nl] INFO: Found listing with ID: CE26691
2026-03-27 12:12:05 [auto1.nl] INFO: Found listing with ID: RC57684
2026-03-27 12:12:05 [auto1.nl] INFO: Found listing with ID: TM57044
2026-03-27 12:12:05 [auto1.nl] INFO: Found listing with ID: FA02352
2026-03-27 12:12:05 [auto1.nl] INFO: Found listing with ID: NG26580
2026-03-27 12:12:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:12:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NG26580%27 HTTP/1.1" 200 None
2026-03-27 12:12:05 [auto1.nl] INFO: Scrape type for NG26580: 0
2026-03-27 12:12:05 [auto1.nl] INFO: Found listing with ID: ZW01223
2026-03-27 12:12:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:12:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZW01223%27 HTTP/1.1" 200 None
2026-03-27 12:12:05 [auto1.nl] INFO: Scrape type for ZW01223: 0
2026-03-27 12:12:05 [auto1.nl] INFO: Found listing with ID: FE52928
2026-03-27 12:12:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:12:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FE52928%27 HTTP/1.1" 200 None
2026-03-27 12:12:05 [auto1.nl] INFO: Scrape type for FE52928: 0
2026-03-27 12:12:05 [auto1.nl] INFO: Found listing with ID: MB44193
2026-03-27 12:12:05 [auto1.nl] INFO: Found listing with ID: NH24631
2026-03-27 12:12:05 [auto1.nl] INFO: Found listing with ID: US73773
2026-03-27 12:12:05 [auto1.nl] INFO: Found listing with ID: GL22662
2026-03-27 12:12:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:12:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GL22662%27 HTTP/1.1" 200 None
2026-03-27 12:12:05 [auto1.nl] INFO: Scrape type for GL22662: 0
2026-03-27 12:12:05 [auto1.nl] INFO: Found listing with ID: KG10005
2026-03-27 12:12:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:12:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KG10005%27 HTTP/1.1" 200 None
2026-03-27 12:12:05 [auto1.nl] INFO: Scrape type for KG10005: 0
2026-03-27 12:12:05 [auto1.nl] INFO: Found listing with ID: ZB42112
2026-03-27 12:12:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:12:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZB42112%27 HTTP/1.1" 200 None
2026-03-27 12:12:05 [auto1.nl] INFO: Scrape type for ZB42112: 0
2026-03-27 12:12:05 [auto1.nl] INFO: Found listing with ID: KJ03037
2026-03-27 12:12:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:12:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KJ03037%27 HTTP/1.1" 200 None
2026-03-27 12:12:05 [auto1.nl] INFO: Scrape type for KJ03037: 0
2026-03-27 12:12:05 [auto1.nl] INFO: Found listing with ID: UW51826
2026-03-27 12:12:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:12:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UW51826%27 HTTP/1.1" 200 None
2026-03-27 12:12:05 [auto1.nl] INFO: Scrape type for UW51826: 0
2026-03-27 12:12:05 [auto1.nl] INFO: Found listing with ID: BC50110
2026-03-27 12:12:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:12:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BC50110%27 HTTP/1.1" 200 None
2026-03-27 12:12:06 [auto1.nl] INFO: Scrape type for BC50110: 0
2026-03-27 12:12:06 [auto1.nl] INFO: Found listing with ID: UV84373
2026-03-27 12:12:06 [auto1.nl] INFO: Found listing with ID: SV58198
2026-03-27 12:12:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:12:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SV58198%27 HTTP/1.1" 200 None
2026-03-27 12:12:06 [auto1.nl] INFO: Scrape type for SV58198: 0
2026-03-27 12:12:06 [auto1.nl] INFO: Found listing with ID: ZA14076
2026-03-27 12:12:06 [auto1.nl] INFO: Found listing with ID: VU97147
2026-03-27 12:12:06 [auto1.nl] INFO: Found listing with ID: RL05615
2026-03-27 12:12:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:12:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RL05615%27 HTTP/1.1" 200 None
2026-03-27 12:12:06 [auto1.nl] INFO: Scrape type for RL05615: 0
2026-03-27 12:12:06 [auto1.nl] INFO: Found listing with ID: CN90357
2026-03-27 12:12:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:12:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CN90357%27 HTTP/1.1" 200 None
2026-03-27 12:12:06 [auto1.nl] INFO: Scrape type for CN90357: 0
2026-03-27 12:12:06 [auto1.nl] INFO: Found listing with ID: LH12020
2026-03-27 12:12:06 [auto1.nl] INFO: Found listing with ID: MP73087
2026-03-27 12:12:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:12:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MP73087%27 HTTP/1.1" 200 None
2026-03-27 12:12:06 [auto1.nl] INFO: Scrape type for MP73087: 0
2026-03-27 12:12:06 [auto1.nl] INFO: Found listing with ID: FW01389
2026-03-27 12:12:06 [auto1.nl] INFO: Found listing with ID: DG50116
2026-03-27 12:12:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:12:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DG50116%27 HTTP/1.1" 200 None
2026-03-27 12:12:06 [auto1.nl] INFO: Scrape type for DG50116: 0
2026-03-27 12:12:06 [auto1.nl] INFO: Found listing with ID: KR09014
2026-03-27 12:12:06 [auto1.nl] INFO: Found listing with ID: MB22774
2026-03-27 12:12:06 [auto1.nl] INFO: Found listing with ID: MR09185
2026-03-27 12:12:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:12:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MR09185%27 HTTP/1.1" 200 None
2026-03-27 12:12:06 [auto1.nl] INFO: Scrape type for MR09185: 0
2026-03-27 12:12:06 [auto1.nl] INFO: Found listing with ID: TC52581
2026-03-27 12:12:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:12:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TC52581%27 HTTP/1.1" 200 None
2026-03-27 12:12:06 [auto1.nl] INFO: Scrape type for TC52581: 0
2026-03-27 12:12:06 [auto1.nl] INFO: Found listing with ID: EL93607
2026-03-27 12:12:06 [auto1.nl] INFO: Found listing with ID: WH81007
2026-03-27 12:12:06 [auto1.nl] INFO: Found listing with ID: SM93407
2026-03-27 12:12:06 [auto1.nl] INFO: Found listing with ID: HK49609
2026-03-27 12:12:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:12:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HK49609%27 HTTP/1.1" 200 None
2026-03-27 12:12:06 [auto1.nl] INFO: Scrape type for HK49609: 0
2026-03-27 12:12:06 [auto1.nl] INFO: Found listing with ID: ME06294
2026-03-27 12:12:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:12:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ME06294%27 HTTP/1.1" 200 None
2026-03-27 12:12:06 [auto1.nl] INFO: Scrape type for ME06294: 0
2026-03-27 12:12:06 [auto1.nl] INFO: Found listing with ID: TF60968
2026-03-27 12:12:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:12:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TF60968%27 HTTP/1.1" 200 None
2026-03-27 12:12:06 [auto1.nl] INFO: Scrape type for TF60968: 0
2026-03-27 12:12:06 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 12:12:06 [scrapy.extensions.logstats] INFO: Crawled 126 pages (at 51 pages/min), scraped 96 items (at 38 items/min)
2026-03-27 12:12:06 [scrapy.extensions.memusage] INFO: Peak memory usage is 189MiB
2026-03-27 12:12:08 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 12:12:08 [auto1.nl] INFO: Channel: 24h | Page: 21 | totalHits: 1060 | hits on page: 40
2026-03-27 12:12:08 [auto1.nl] INFO: Found listing with ID: CF21712
2026-03-27 12:12:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:12:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CF21712%27 HTTP/1.1" 200 None
2026-03-27 12:12:08 [auto1.nl] INFO: Scrape type for CF21712: 0
2026-03-27 12:12:08 [auto1.nl] INFO: Found listing with ID: RL70309
2026-03-27 12:12:08 [auto1.nl] INFO: Found listing with ID: HK88309
2026-03-27 12:12:08 [auto1.nl] INFO: Found listing with ID: YC94295
2026-03-27 12:12:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:12:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YC94295%27 HTTP/1.1" 200 None
2026-03-27 12:12:08 [auto1.nl] INFO: Scrape type for YC94295: 0
2026-03-27 12:12:08 [auto1.nl] INFO: Found listing with ID: HA11367
2026-03-27 12:12:08 [auto1.nl] INFO: Found listing with ID: EW02836
2026-03-27 12:12:08 [auto1.nl] INFO: Found listing with ID: HW48392
2026-03-27 12:12:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:12:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HW48392%27 HTTP/1.1" 200 None
2026-03-27 12:12:08 [auto1.nl] INFO: Scrape type for HW48392: 0
2026-03-27 12:12:08 [auto1.nl] INFO: Found listing with ID: CM82546
2026-03-27 12:12:08 [auto1.nl] INFO: Found listing with ID: JK88621
2026-03-27 12:12:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:12:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JK88621%27 HTTP/1.1" 200 None
2026-03-27 12:12:08 [auto1.nl] INFO: Scrape type for JK88621: 0
2026-03-27 12:12:08 [auto1.nl] INFO: Found listing with ID: XN26994
2026-03-27 12:12:08 [auto1.nl] INFO: Found listing with ID: EK38089
2026-03-27 12:12:08 [auto1.nl] INFO: Found listing with ID: SH43591
2026-03-27 12:12:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:12:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SH43591%27 HTTP/1.1" 200 None
2026-03-27 12:12:08 [auto1.nl] INFO: Scrape type for SH43591: 0
2026-03-27 12:12:08 [auto1.nl] INFO: Found listing with ID: LU83430
2026-03-27 12:12:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:12:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LU83430%27 HTTP/1.1" 200 None
2026-03-27 12:12:08 [auto1.nl] INFO: Scrape type for LU83430: 0
2026-03-27 12:12:08 [auto1.nl] INFO: Found listing with ID: PS47079
2026-03-27 12:12:08 [auto1.nl] INFO: Found listing with ID: SU37312
2026-03-27 12:12:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:12:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SU37312%27 HTTP/1.1" 200 None
2026-03-27 12:12:08 [auto1.nl] INFO: Scrape type for SU37312: 0
2026-03-27 12:12:08 [auto1.nl] INFO: Found listing with ID: RX84847
2026-03-27 12:12:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:12:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RX84847%27 HTTP/1.1" 200 None
2026-03-27 12:12:08 [auto1.nl] INFO: Scrape type for RX84847: 0
2026-03-27 12:12:08 [auto1.nl] INFO: Found listing with ID: KM26805
2026-03-27 12:12:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:12:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KM26805%27 HTTP/1.1" 200 None
2026-03-27 12:12:08 [auto1.nl] INFO: Scrape type for KM26805: 0
2026-03-27 12:12:08 [auto1.nl] INFO: Found listing with ID: TY10143
2026-03-27 12:12:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:12:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TY10143%27 HTTP/1.1" 200 None
2026-03-27 12:12:08 [auto1.nl] INFO: Scrape type for TY10143: 0
2026-03-27 12:12:08 [auto1.nl] INFO: Found listing with ID: HH63171
2026-03-27 12:12:08 [auto1.nl] INFO: Found listing with ID: HA66604
2026-03-27 12:12:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:12:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HA66604%27 HTTP/1.1" 200 None
2026-03-27 12:12:08 [auto1.nl] INFO: Scrape type for HA66604: 0
2026-03-27 12:12:08 [auto1.nl] INFO: Found listing with ID: VR01331
2026-03-27 12:12:08 [auto1.nl] INFO: Found listing with ID: CL07612
2026-03-27 12:12:08 [auto1.nl] INFO: Found listing with ID: JY14630
2026-03-27 12:12:08 [auto1.nl] INFO: Found listing with ID: FP91104
2026-03-27 12:12:08 [auto1.nl] INFO: Found listing with ID: ZY13859
2026-03-27 12:12:08 [auto1.nl] INFO: Found listing with ID: VK83844
2026-03-27 12:12:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:12:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VK83844%27 HTTP/1.1" 200 None
2026-03-27 12:12:08 [auto1.nl] INFO: Scrape type for VK83844: 0
2026-03-27 12:12:08 [auto1.nl] INFO: Found listing with ID: CX09180
2026-03-27 12:12:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:12:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CX09180%27 HTTP/1.1" 200 None
2026-03-27 12:12:08 [auto1.nl] INFO: Scrape type for CX09180: 0
2026-03-27 12:12:08 [auto1.nl] INFO: Found listing with ID: WU69480
2026-03-27 12:12:08 [auto1.nl] INFO: Found listing with ID: DZ17172
2026-03-27 12:12:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:12:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DZ17172%27 HTTP/1.1" 200 None
2026-03-27 12:12:08 [auto1.nl] INFO: Scrape type for DZ17172: 0
2026-03-27 12:12:08 [auto1.nl] INFO: Found listing with ID: EC94380
2026-03-27 12:12:08 [auto1.nl] INFO: Found listing with ID: VM58472
2026-03-27 12:12:08 [auto1.nl] INFO: Found listing with ID: FS28745
2026-03-27 12:12:08 [auto1.nl] INFO: Found listing with ID: ZR54060
2026-03-27 12:12:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:12:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZR54060%27 HTTP/1.1" 200 None
2026-03-27 12:12:08 [auto1.nl] INFO: Scrape type for ZR54060: 0
2026-03-27 12:12:08 [auto1.nl] INFO: Found listing with ID: SV30356
2026-03-27 12:12:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:12:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SV30356%27 HTTP/1.1" 200 None
2026-03-27 12:12:08 [auto1.nl] INFO: Scrape type for SV30356: 0
2026-03-27 12:12:08 [auto1.nl] INFO: Found listing with ID: CT46548
2026-03-27 12:12:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:12:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CT46548%27 HTTP/1.1" 200 None
2026-03-27 12:12:08 [auto1.nl] INFO: Scrape type for CT46548: 0
2026-03-27 12:12:08 [auto1.nl] INFO: Found listing with ID: EG10969
2026-03-27 12:12:08 [auto1.nl] INFO: Found listing with ID: KM02956
2026-03-27 12:12:08 [auto1.nl] INFO: Found listing with ID: YV28666
2026-03-27 12:12:08 [auto1.nl] INFO: Found listing with ID: KW55792
2026-03-27 12:12:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:12:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KW55792%27 HTTP/1.1" 200 None
2026-03-27 12:12:08 [auto1.nl] INFO: Scrape type for KW55792: 0
2026-03-27 12:12:08 [auto1.nl] INFO: Found listing with ID: AC01356
2026-03-27 12:12:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:12:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AC01356%27 HTTP/1.1" 200 None
2026-03-27 12:12:08 [auto1.nl] INFO: Scrape type for AC01356: 0
2026-03-27 12:12:08 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 12:12:09 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 12:12:09 [auto1.nl] INFO: Channel: 24h | Page: 22 | totalHits: 1060 | hits on page: 40
2026-03-27 12:12:09 [auto1.nl] INFO: Found listing with ID: NP98125
2026-03-27 12:12:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:12:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NP98125%27 HTTP/1.1" 200 None
2026-03-27 12:12:09 [auto1.nl] INFO: Scrape type for NP98125: 0
2026-03-27 12:12:09 [auto1.nl] INFO: Found listing with ID: RH89754
2026-03-27 12:12:09 [auto1.nl] INFO: Found listing with ID: ZG15483
2026-03-27 12:12:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:12:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZG15483%27 HTTP/1.1" 200 None
2026-03-27 12:12:09 [auto1.nl] INFO: Scrape type for ZG15483: 0
2026-03-27 12:12:09 [auto1.nl] INFO: Found listing with ID: AG60358
2026-03-27 12:12:09 [auto1.nl] INFO: Found listing with ID: SZ31943
2026-03-27 12:12:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:12:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SZ31943%27 HTTP/1.1" 200 None
2026-03-27 12:12:09 [auto1.nl] INFO: Scrape type for SZ31943: 0
2026-03-27 12:12:09 [auto1.nl] INFO: Found listing with ID: RJ35117
2026-03-27 12:12:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:12:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RJ35117%27 HTTP/1.1" 200 None
2026-03-27 12:12:09 [auto1.nl] INFO: Scrape type for RJ35117: 0
2026-03-27 12:12:09 [auto1.nl] INFO: Found listing with ID: FC19497
2026-03-27 12:12:09 [auto1.nl] INFO: Found listing with ID: CF65603
2026-03-27 12:12:09 [auto1.nl] INFO: Found listing with ID: MM63148
2026-03-27 12:12:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:12:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MM63148%27 HTTP/1.1" 200 None
2026-03-27 12:12:09 [auto1.nl] INFO: Scrape type for MM63148: 0
2026-03-27 12:12:09 [auto1.nl] INFO: Found listing with ID: JP27476
2026-03-27 12:12:09 [auto1.nl] INFO: Found listing with ID: DB35159
2026-03-27 12:12:09 [auto1.nl] INFO: Found listing with ID: GS00430
2026-03-27 12:12:09 [auto1.nl] INFO: Found listing with ID: VY67313
2026-03-27 12:12:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:12:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VY67313%27 HTTP/1.1" 200 None
2026-03-27 12:12:09 [auto1.nl] INFO: Scrape type for VY67313: 0
2026-03-27 12:12:09 [auto1.nl] INFO: Found listing with ID: CV91211
2026-03-27 12:12:09 [auto1.nl] INFO: Found listing with ID: PZ98334
2026-03-27 12:12:09 [auto1.nl] INFO: Found listing with ID: WV92196
2026-03-27 12:12:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:12:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WV92196%27 HTTP/1.1" 200 None
2026-03-27 12:12:09 [auto1.nl] INFO: Scrape type for WV92196: 0
2026-03-27 12:12:09 [auto1.nl] INFO: Found listing with ID: UD77353
2026-03-27 12:12:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:12:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UD77353%27 HTTP/1.1" 200 None
2026-03-27 12:12:09 [auto1.nl] INFO: Scrape type for UD77353: 0
2026-03-27 12:12:09 [auto1.nl] INFO: Found listing with ID: VJ98310
2026-03-27 12:12:09 [auto1.nl] INFO: Found listing with ID: KE35352
2026-03-27 12:12:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:12:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KE35352%27 HTTP/1.1" 200 None
2026-03-27 12:12:09 [auto1.nl] INFO: Scrape type for KE35352: 0
2026-03-27 12:12:09 [auto1.nl] INFO: Found listing with ID: XJ29881
2026-03-27 12:12:09 [auto1.nl] INFO: Found listing with ID: ZN86859
2026-03-27 12:12:09 [auto1.nl] INFO: Found listing with ID: UN11563
2026-03-27 12:12:09 [auto1.nl] INFO: Found listing with ID: JR20080
2026-03-27 12:12:09 [auto1.nl] INFO: Found listing with ID: BC93744
2026-03-27 12:12:09 [auto1.nl] INFO: Found listing with ID: BF62657
2026-03-27 12:12:09 [auto1.nl] INFO: Found listing with ID: BV93100
2026-03-27 12:12:09 [auto1.nl] INFO: Found listing with ID: PL63147
2026-03-27 12:12:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:12:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PL63147%27 HTTP/1.1" 200 None
2026-03-27 12:12:09 [auto1.nl] INFO: Scrape type for PL63147: 0
2026-03-27 12:12:09 [auto1.nl] INFO: Found listing with ID: GE68887
2026-03-27 12:12:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:12:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GE68887%27 HTTP/1.1" 200 None
2026-03-27 12:12:09 [auto1.nl] INFO: Scrape type for GE68887: 0
2026-03-27 12:12:09 [auto1.nl] INFO: Found listing with ID: FL44315
2026-03-27 12:12:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:12:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FL44315%27 HTTP/1.1" 200 None
2026-03-27 12:12:09 [auto1.nl] INFO: Scrape type for FL44315: 0
2026-03-27 12:12:09 [auto1.nl] INFO: Found listing with ID: VC25244
2026-03-27 12:12:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:12:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VC25244%27 HTTP/1.1" 200 None
2026-03-27 12:12:09 [auto1.nl] INFO: Scrape type for VC25244: 0
2026-03-27 12:12:09 [auto1.nl] INFO: Found listing with ID: MX43508
2026-03-27 12:12:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:12:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MX43508%27 HTTP/1.1" 200 None
2026-03-27 12:12:09 [auto1.nl] INFO: Scrape type for MX43508: 0
2026-03-27 12:12:09 [auto1.nl] INFO: Found listing with ID: MC51093
2026-03-27 12:12:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:12:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MC51093%27 HTTP/1.1" 200 None
2026-03-27 12:12:09 [auto1.nl] INFO: Scrape type for MC51093: 0
2026-03-27 12:12:09 [auto1.nl] INFO: Found listing with ID: BL87851
2026-03-27 12:12:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:12:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BL87851%27 HTTP/1.1" 200 None
2026-03-27 12:12:09 [auto1.nl] INFO: Scrape type for BL87851: 0
2026-03-27 12:12:09 [auto1.nl] INFO: Found listing with ID: EG61372
2026-03-27 12:12:09 [auto1.nl] INFO: Found listing with ID: KT95598
2026-03-27 12:12:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:12:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KT95598%27 HTTP/1.1" 200 None
2026-03-27 12:12:10 [auto1.nl] INFO: Scrape type for KT95598: 0
2026-03-27 12:12:10 [auto1.nl] INFO: Found listing with ID: YF94322
2026-03-27 12:12:10 [auto1.nl] INFO: Found listing with ID: RX16781
2026-03-27 12:12:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:12:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RX16781%27 HTTP/1.1" 200 None
2026-03-27 12:12:10 [auto1.nl] INFO: Scrape type for RX16781: 0
2026-03-27 12:12:10 [auto1.nl] INFO: Found listing with ID: BZ75535
2026-03-27 12:12:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:12:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BZ75535%27 HTTP/1.1" 200 None
2026-03-27 12:12:10 [auto1.nl] INFO: Scrape type for BZ75535: 0
2026-03-27 12:12:10 [auto1.nl] INFO: Found listing with ID: RJ32742
2026-03-27 12:12:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:12:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RJ32742%27 HTTP/1.1" 200 None
2026-03-27 12:12:10 [auto1.nl] INFO: Scrape type for RJ32742: 0
2026-03-27 12:12:10 [auto1.nl] INFO: Found listing with ID: VJ06664
2026-03-27 12:12:10 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 12:12:10 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 12:12:11 [auto1.nl] INFO: Channel: 24h | Page: 23 | totalHits: 1060 | hits on page: 40
2026-03-27 12:12:11 [auto1.nl] INFO: Found listing with ID: ZL38920
2026-03-27 12:12:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:12:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZL38920%27 HTTP/1.1" 200 None
2026-03-27 12:12:11 [auto1.nl] INFO: Scrape type for ZL38920: 0
2026-03-27 12:12:11 [auto1.nl] INFO: Found listing with ID: HL97424
2026-03-27 12:12:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:12:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HL97424%27 HTTP/1.1" 200 None
2026-03-27 12:12:11 [auto1.nl] INFO: Scrape type for HL97424: 0
2026-03-27 12:12:11 [auto1.nl] INFO: Found listing with ID: PZ82543
2026-03-27 12:12:11 [auto1.nl] INFO: Found listing with ID: DU88284
2026-03-27 12:12:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:12:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DU88284%27 HTTP/1.1" 200 None
2026-03-27 12:12:11 [auto1.nl] INFO: Scrape type for DU88284: 0
2026-03-27 12:12:11 [auto1.nl] INFO: Found listing with ID: ZU52979
2026-03-27 12:12:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:12:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZU52979%27 HTTP/1.1" 200 None
2026-03-27 12:12:11 [auto1.nl] INFO: Scrape type for ZU52979: 0
2026-03-27 12:12:11 [auto1.nl] INFO: Found listing with ID: UU92567
2026-03-27 12:12:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:12:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UU92567%27 HTTP/1.1" 200 None
2026-03-27 12:12:11 [auto1.nl] INFO: Scrape type for UU92567: 0
2026-03-27 12:12:11 [auto1.nl] INFO: Found listing with ID: LT61011
2026-03-27 12:12:11 [auto1.nl] INFO: Found listing with ID: LN13615
2026-03-27 12:12:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:12:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LN13615%27 HTTP/1.1" 200 None
2026-03-27 12:12:11 [auto1.nl] INFO: Scrape type for LN13615: 0
2026-03-27 12:12:11 [auto1.nl] INFO: Found listing with ID: NR95179
2026-03-27 12:12:11 [auto1.nl] INFO: Found listing with ID: XD32446
2026-03-27 12:12:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:12:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27XD32446%27 HTTP/1.1" 200 None
2026-03-27 12:12:11 [auto1.nl] INFO: Scrape type for XD32446: 0
2026-03-27 12:12:11 [auto1.nl] INFO: Found listing with ID: NK23750
2026-03-27 12:12:11 [auto1.nl] INFO: Found listing with ID: CH10226
2026-03-27 12:12:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:12:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CH10226%27 HTTP/1.1" 200 None
2026-03-27 12:12:11 [auto1.nl] INFO: Scrape type for CH10226: 0
2026-03-27 12:12:11 [auto1.nl] INFO: Found listing with ID: TP84646
2026-03-27 12:12:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:12:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TP84646%27 HTTP/1.1" 200 None
2026-03-27 12:12:11 [auto1.nl] INFO: Scrape type for TP84646: 0
2026-03-27 12:12:11 [auto1.nl] INFO: Found listing with ID: SH85399
2026-03-27 12:12:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:12:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SH85399%27 HTTP/1.1" 200 None
2026-03-27 12:12:11 [auto1.nl] INFO: Scrape type for SH85399: 0
2026-03-27 12:12:11 [auto1.nl] INFO: Found listing with ID: BM96536
2026-03-27 12:12:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:12:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BM96536%27 HTTP/1.1" 200 None
2026-03-27 12:12:11 [auto1.nl] INFO: Scrape type for BM96536: 0
2026-03-27 12:12:11 [auto1.nl] INFO: Found listing with ID: RT17278
2026-03-27 12:12:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:12:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RT17278%27 HTTP/1.1" 200 None
2026-03-27 12:12:11 [auto1.nl] INFO: Scrape type for RT17278: 0
2026-03-27 12:12:11 [auto1.nl] INFO: Found listing with ID: MX82019
2026-03-27 12:12:11 [auto1.nl] INFO: Found listing with ID: HN21627
2026-03-27 12:12:11 [auto1.nl] INFO: Found listing with ID: DA29812
2026-03-27 12:12:11 [auto1.nl] INFO: Found listing with ID: ME98271
2026-03-27 12:12:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:12:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ME98271%27 HTTP/1.1" 200 None
2026-03-27 12:12:11 [auto1.nl] INFO: Scrape type for ME98271: 0
2026-03-27 12:12:11 [auto1.nl] INFO: Found listing with ID: KT18322
2026-03-27 12:12:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:12:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KT18322%27 HTTP/1.1" 200 None
2026-03-27 12:12:11 [auto1.nl] INFO: Scrape type for KT18322: 0
2026-03-27 12:12:11 [auto1.nl] INFO: Found listing with ID: KZ09082
2026-03-27 12:12:11 [auto1.nl] INFO: Found listing with ID: GY41852
2026-03-27 12:12:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:12:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GY41852%27 HTTP/1.1" 200 None
2026-03-27 12:12:11 [auto1.nl] INFO: Scrape type for GY41852: 0
2026-03-27 12:12:11 [auto1.nl] INFO: Found listing with ID: WP19214
2026-03-27 12:12:11 [auto1.nl] INFO: Found listing with ID: MM08239
2026-03-27 12:12:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:12:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MM08239%27 HTTP/1.1" 200 None
2026-03-27 12:12:11 [auto1.nl] INFO: Scrape type for MM08239: 0
2026-03-27 12:12:11 [auto1.nl] INFO: Found listing with ID: VH08569
2026-03-27 12:12:11 [auto1.nl] INFO: Found listing with ID: ML63258
2026-03-27 12:12:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:12:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ML63258%27 HTTP/1.1" 200 None
2026-03-27 12:12:11 [auto1.nl] INFO: Scrape type for ML63258: 0
2026-03-27 12:12:11 [auto1.nl] INFO: Found listing with ID: NB25760
2026-03-27 12:12:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:12:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NB25760%27 HTTP/1.1" 200 None
2026-03-27 12:12:11 [auto1.nl] INFO: Scrape type for NB25760: 0
2026-03-27 12:12:11 [auto1.nl] INFO: Found listing with ID: BD28084
2026-03-27 12:12:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:12:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BD28084%27 HTTP/1.1" 200 None
2026-03-27 12:12:11 [auto1.nl] INFO: Scrape type for BD28084: 0
2026-03-27 12:12:11 [auto1.nl] INFO: Found listing with ID: VL52985
2026-03-27 12:12:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:12:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VL52985%27 HTTP/1.1" 200 None
2026-03-27 12:12:11 [auto1.nl] INFO: Scrape type for VL52985: 0
2026-03-27 12:12:11 [auto1.nl] INFO: Found listing with ID: MH16372
2026-03-27 12:12:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:12:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MH16372%27 HTTP/1.1" 200 None
2026-03-27 12:12:11 [auto1.nl] INFO: Scrape type for MH16372: 0
2026-03-27 12:12:11 [auto1.nl] INFO: Found listing with ID: AB85439
2026-03-27 12:12:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:12:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AB85439%27 HTTP/1.1" 200 None
2026-03-27 12:12:11 [auto1.nl] INFO: Scrape type for AB85439: 0
2026-03-27 12:12:11 [auto1.nl] INFO: Found listing with ID: EG83115
2026-03-27 12:12:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:12:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EG83115%27 HTTP/1.1" 200 None
2026-03-27 12:12:11 [auto1.nl] INFO: Scrape type for EG83115: 0
2026-03-27 12:12:11 [auto1.nl] INFO: Found listing with ID: CL96583
2026-03-27 12:12:11 [auto1.nl] INFO: Found listing with ID: TA93955
2026-03-27 12:12:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:12:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TA93955%27 HTTP/1.1" 200 None
2026-03-27 12:12:11 [auto1.nl] INFO: Scrape type for TA93955: 2
2026-03-27 12:12:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 97136638-6d6f-5af0-9871-99ecd9c6728b with identifier: TA93955
2026-03-27 12:12:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 97136638-6d6f-5af0-9871-99ecd9c6728b with scrape type 2
2026-03-27 12:12:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 97136638-6d6f-5af0-9871-99ecd9c6728b with scrape type 2
2026-03-27 12:12:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 97136638-6d6f-5af0-9871-99ecd9c6728b, identifier: TA93955
2026-03-27 12:12:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 97136638-6d6f-5af0-9871-99ecd9c6728b with identifier: TA93955
2026-03-27 12:12:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 97136638-6d6f-5af0-9871-99ecd9c6728b with identifier: TA93955
2026-03-27 12:12:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 97136638-6d6f-5af0-9871-99ecd9c6728b with identifier: TA93955 to the API
2026-03-27 12:12:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 12:12:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 12:12:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 141,
 'expiration_date': '2026-03-27T16:23:05Z',
 'fuel_type': 'hybrid',
 'id': '97136638-6d6f-5af0-9871-99ecd9c6728b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TA93955',
 'listing': 'auction',
 'make': 'Kia',
 'model': 'Niro',
 'odometer': 72938,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-11-02',
 'seller_name': None,
 'title': 'Kia Niro 1.6 Hybrid Spirit',
 'transmission': 'automatic',
 'trim': 'Spirit',
 'year': 2017}
2026-03-27 12:12:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:12:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TA93955%27 HTTP/1.1" 200 None
2026-03-27 12:12:12 [auto1.nl] INFO: Saving data for TA93955: {'auction_closing_time': 1774628585.0, 'created_time': 1774527079.700152, 'last_price_update_time': 1774613532.172758}
2026-03-27 12:12:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:12:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='TA93955') HTTP/1.1" 204 0
2026-03-27 12:12:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 12:12:12 [auto1.nl] INFO: Found listing with ID: JC34887
2026-03-27 12:12:12 [auto1.nl] INFO: Found listing with ID: YW81523
2026-03-27 12:12:12 [auto1.nl] INFO: Found listing with ID: YF09192
2026-03-27 12:12:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:12:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YF09192%27 HTTP/1.1" 200 None
2026-03-27 12:12:12 [auto1.nl] INFO: Scrape type for YF09192: 2
2026-03-27 12:12:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f9179521-6309-5cff-8743-4a05c9393a36 with identifier: YF09192
2026-03-27 12:12:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f9179521-6309-5cff-8743-4a05c9393a36 with scrape type 2
2026-03-27 12:12:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f9179521-6309-5cff-8743-4a05c9393a36 with scrape type 2
2026-03-27 12:12:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: f9179521-6309-5cff-8743-4a05c9393a36, identifier: YF09192
2026-03-27 12:12:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: f9179521-6309-5cff-8743-4a05c9393a36 with identifier: YF09192
2026-03-27 12:12:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: f9179521-6309-5cff-8743-4a05c9393a36 with identifier: YF09192
2026-03-27 12:12:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: f9179521-6309-5cff-8743-4a05c9393a36 with identifier: YF09192 to the API
2026-03-27 12:12:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 12:12:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 12:12:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 163,
 'expiration_date': '2026-03-27T16:22:20Z',
 'fuel_type': 'petrol',
 'id': 'f9179521-6309-5cff-8743-4a05c9393a36',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YF09192',
 'listing': 'auction',
 'make': 'Kia',
 'model': 'Sportage',
 'odometer': 260908,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-01-20',
 'seller_name': None,
 'title': 'Kia Sportage 2.0 Attract 2WD',
 'transmission': 'manual',
 'trim': 'Attract 2WD',
 'year': 2011}
2026-03-27 12:12:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:12:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YF09192%27 HTTP/1.1" 200 None
2026-03-27 12:12:12 [auto1.nl] INFO: Saving data for YF09192: {'auction_closing_time': 1774628540.0, 'created_time': 1774527080.636805, 'last_price_update_time': 1774613532.651782}
2026-03-27 12:12:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:12:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='YF09192') HTTP/1.1" 204 0
2026-03-27 12:12:12 [auto1.nl] INFO: Found listing with ID: SE84312
2026-03-27 12:12:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:12:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SE84312%27 HTTP/1.1" 200 None
2026-03-27 12:12:12 [auto1.nl] INFO: Scrape type for SE84312: 2
2026-03-27 12:12:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 189b5ee9-47ba-5495-b9f5-3697f87dccda with identifier: SE84312
2026-03-27 12:12:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 189b5ee9-47ba-5495-b9f5-3697f87dccda with scrape type 2
2026-03-27 12:12:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 189b5ee9-47ba-5495-b9f5-3697f87dccda with scrape type 2
2026-03-27 12:12:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 189b5ee9-47ba-5495-b9f5-3697f87dccda, identifier: SE84312
2026-03-27 12:12:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 189b5ee9-47ba-5495-b9f5-3697f87dccda with identifier: SE84312
2026-03-27 12:12:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 189b5ee9-47ba-5495-b9f5-3697f87dccda with identifier: SE84312
2026-03-27 12:12:12 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 189b5ee9-47ba-5495-b9f5-3697f87dccda with identifier: SE84312 to the API
2026-03-27 12:12:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 12:12:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 12:12:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 101,
 'expiration_date': '2026-03-27T16:52:43Z',
 'fuel_type': 'petrol',
 'id': '189b5ee9-47ba-5495-b9f5-3697f87dccda',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SE84312',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '208',
 'odometer': 21936,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2023-11-12',
 'seller_name': None,
 'title': 'Peugeot 208 1.2 PureTech GT',
 'transmission': 'automatic',
 'trim': 'GT',
 'year': 2023}
2026-03-27 12:12:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:12:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SE84312%27 HTTP/1.1" 200 None
2026-03-27 12:12:13 [auto1.nl] INFO: Saving data for SE84312: {'auction_closing_time': 1774630363.0, 'created_time': 1774527021.539652, 'last_price_update_time': 1774613533.042371}
2026-03-27 12:12:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:12:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='SE84312') HTTP/1.1" 204 0
2026-03-27 12:12:13 [auto1.nl] INFO: Found listing with ID: VD56637
2026-03-27 12:12:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:12:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VD56637%27 HTTP/1.1" 200 None
2026-03-27 12:12:13 [auto1.nl] INFO: Scrape type for VD56637: 2
2026-03-27 12:12:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e083aad3-7d95-5383-a11e-66a3df59ba04 with identifier: VD56637
2026-03-27 12:12:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e083aad3-7d95-5383-a11e-66a3df59ba04 with scrape type 2
2026-03-27 12:12:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e083aad3-7d95-5383-a11e-66a3df59ba04 with scrape type 2
2026-03-27 12:12:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: e083aad3-7d95-5383-a11e-66a3df59ba04, identifier: VD56637
2026-03-27 12:12:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: e083aad3-7d95-5383-a11e-66a3df59ba04 with identifier: VD56637
2026-03-27 12:12:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: e083aad3-7d95-5383-a11e-66a3df59ba04 with identifier: VD56637
2026-03-27 12:12:13 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: e083aad3-7d95-5383-a11e-66a3df59ba04 with identifier: VD56637 to the API
2026-03-27 12:12:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 12:12:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 12:12:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-27T16:36:38Z',
 'fuel_type': 'petrol',
 'id': 'e083aad3-7d95-5383-a11e-66a3df59ba04',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VD56637',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C3',
 'odometer': 69047,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-01-30',
 'seller_name': None,
 'title': 'Citroen C3 1.2 PureTech Feel',
 'transmission': 'manual',
 'trim': 'Feel',
 'year': 2020}
2026-03-27 12:12:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:12:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VD56637%27 HTTP/1.1" 200 None
2026-03-27 12:12:13 [auto1.nl] INFO: Saving data for VD56637: {'auction_closing_time': 1774629398.0, 'created_time': 1774527026.955858, 'last_price_update_time': 1774613533.464583}
2026-03-27 12:12:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:12:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='VD56637') HTTP/1.1" 204 0
2026-03-27 12:12:14 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 12:12:14 [auto1.nl] INFO: Channel: 24h | Page: 24 | totalHits: 1060 | hits on page: 40
2026-03-27 12:12:14 [auto1.nl] INFO: Found listing with ID: DV35318
2026-03-27 12:12:14 [auto1.nl] INFO: Found listing with ID: XJ86601
2026-03-27 12:12:14 [auto1.nl] INFO: Found listing with ID: BM26306
2026-03-27 12:12:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:12:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BM26306%27 HTTP/1.1" 200 None
2026-03-27 12:12:14 [auto1.nl] INFO: Scrape type for BM26306: 2
2026-03-27 12:12:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 28619a19-5b65-56e6-ac80-f71dc61fb231 with identifier: BM26306
2026-03-27 12:12:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 28619a19-5b65-56e6-ac80-f71dc61fb231 with scrape type 2
2026-03-27 12:12:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 28619a19-5b65-56e6-ac80-f71dc61fb231 with scrape type 2
2026-03-27 12:12:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 28619a19-5b65-56e6-ac80-f71dc61fb231, identifier: BM26306
2026-03-27 12:12:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 28619a19-5b65-56e6-ac80-f71dc61fb231 with identifier: BM26306
2026-03-27 12:12:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 28619a19-5b65-56e6-ac80-f71dc61fb231 with identifier: BM26306
2026-03-27 12:12:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 28619a19-5b65-56e6-ac80-f71dc61fb231 with identifier: BM26306 to the API
2026-03-27 12:12:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 12:12:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 12:12:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-27T16:54:51Z',
 'fuel_type': 'petrol',
 'id': '28619a19-5b65-56e6-ac80-f71dc61fb231',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BM26306',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '208',
 'odometer': 172936,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-11-17',
 'seller_name': None,
 'title': 'Peugeot 208 1.2 PureTech Allure',
 'transmission': 'manual',
 'trim': 'Allure',
 'year': 2016}
2026-03-27 12:12:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:12:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BM26306%27 HTTP/1.1" 200 None
2026-03-27 12:12:14 [auto1.nl] INFO: Saving data for BM26306: {'auction_closing_time': 1774630491.0, 'created_time': 1774527026.469105, 'last_price_update_time': 1774613534.698503}
2026-03-27 12:12:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:12:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='BM26306') HTTP/1.1" 204 0
2026-03-27 12:12:14 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 12:12:14 [auto1.nl] INFO: Found listing with ID: JL68792
2026-03-27 12:12:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:12:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JL68792%27 HTTP/1.1" 200 None
2026-03-27 12:12:14 [auto1.nl] INFO: Scrape type for JL68792: 2
2026-03-27 12:12:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e5dbde58-d27d-5136-84c9-f5b5d801d9b1 with identifier: JL68792
2026-03-27 12:12:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e5dbde58-d27d-5136-84c9-f5b5d801d9b1 with scrape type 2
2026-03-27 12:12:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e5dbde58-d27d-5136-84c9-f5b5d801d9b1 with scrape type 2
2026-03-27 12:12:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: e5dbde58-d27d-5136-84c9-f5b5d801d9b1, identifier: JL68792
2026-03-27 12:12:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: e5dbde58-d27d-5136-84c9-f5b5d801d9b1 with identifier: JL68792
2026-03-27 12:12:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: e5dbde58-d27d-5136-84c9-f5b5d801d9b1 with identifier: JL68792
2026-03-27 12:12:14 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: e5dbde58-d27d-5136-84c9-f5b5d801d9b1 with identifier: JL68792 to the API
2026-03-27 12:12:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 12:12:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 12:12:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 279,
 'expiration_date': '2026-03-27T16:03:33Z',
 'fuel_type': 'hybrid',
 'id': 'e5dbde58-d27d-5136-84c9-f5b5d801d9b1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JL68792',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'C-Klasse',
 'odometer': 231516,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-07-27',
 'seller_name': None,
 'title': 'Mercedes-Benz C-Klasse C 350e T Avantgarde',
 'transmission': 'automatic',
 'trim': 'T Avantgarde',
 'year': 2015}
2026-03-27 12:12:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:12:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JL68792%27 HTTP/1.1" 200 None
2026-03-27 12:12:15 [auto1.nl] INFO: Saving data for JL68792: {'auction_closing_time': 1774627413.0, 'created_time': 1773302384.6079, 'last_price_update_time': 1774613535.108753}
2026-03-27 12:12:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:12:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='JL68792') HTTP/1.1" 204 0
2026-03-27 12:12:15 [auto1.nl] INFO: Found listing with ID: TL29950
2026-03-27 12:12:15 [auto1.nl] INFO: Found listing with ID: EX12849
2026-03-27 12:12:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:12:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EX12849%27 HTTP/1.1" 200 None
2026-03-27 12:12:15 [auto1.nl] INFO: Scrape type for EX12849: 2
2026-03-27 12:12:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 21f4dcd0-0e74-5d4e-9759-ba1a4c2120e8 with identifier: EX12849
2026-03-27 12:12:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 21f4dcd0-0e74-5d4e-9759-ba1a4c2120e8 with scrape type 2
2026-03-27 12:12:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 21f4dcd0-0e74-5d4e-9759-ba1a4c2120e8 with scrape type 2
2026-03-27 12:12:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 21f4dcd0-0e74-5d4e-9759-ba1a4c2120e8, identifier: EX12849
2026-03-27 12:12:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 21f4dcd0-0e74-5d4e-9759-ba1a4c2120e8 with identifier: EX12849
2026-03-27 12:12:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 21f4dcd0-0e74-5d4e-9759-ba1a4c2120e8 with identifier: EX12849
2026-03-27 12:12:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 21f4dcd0-0e74-5d4e-9759-ba1a4c2120e8 with identifier: EX12849 to the API
2026-03-27 12:12:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 12:12:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 12:12:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 95,
 'expiration_date': '2026-03-27T16:46:03Z',
 'fuel_type': 'petrol',
 'id': '21f4dcd0-0e74-5d4e-9759-ba1a4c2120e8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EX12849',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Fabia',
 'odometer': 231014,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-05-31',
 'seller_name': None,
 'title': 'Skoda Fabia 1.0 TSI Clever',
 'transmission': 'manual',
 'trim': 'Clever',
 'year': 2018}
2026-03-27 12:12:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:12:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EX12849%27 HTTP/1.1" 200 None
2026-03-27 12:12:15 [auto1.nl] INFO: Saving data for EX12849: {'auction_closing_time': 1774629963.0, 'created_time': 1773229575.798314, 'last_price_update_time': 1774613535.486518}
2026-03-27 12:12:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:12:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='EX12849') HTTP/1.1" 204 0
2026-03-27 12:12:15 [auto1.nl] INFO: Found listing with ID: CN71402
2026-03-27 12:12:15 [auto1.nl] INFO: Found listing with ID: TK93788
2026-03-27 12:12:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:12:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TK93788%27 HTTP/1.1" 200 None
2026-03-27 12:12:15 [auto1.nl] INFO: Scrape type for TK93788: 2
2026-03-27 12:12:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e81de0e5-80da-540a-8804-8cf64a5159be with identifier: TK93788
2026-03-27 12:12:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e81de0e5-80da-540a-8804-8cf64a5159be with scrape type 2
2026-03-27 12:12:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e81de0e5-80da-540a-8804-8cf64a5159be with scrape type 2
2026-03-27 12:12:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: e81de0e5-80da-540a-8804-8cf64a5159be, identifier: TK93788
2026-03-27 12:12:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: e81de0e5-80da-540a-8804-8cf64a5159be with identifier: TK93788
2026-03-27 12:12:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: e81de0e5-80da-540a-8804-8cf64a5159be with identifier: TK93788
2026-03-27 12:12:15 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: e81de0e5-80da-540a-8804-8cf64a5159be with identifier: TK93788 to the API
2026-03-27 12:12:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 12:12:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 12:12:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-27T16:35:30Z',
 'fuel_type': 'petrol',
 'id': 'e81de0e5-80da-540a-8804-8cf64a5159be',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TK93788',
 'listing': 'auction',
 'make': 'Dacia',
 'model': 'Sandero',
 'odometer': 174153,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-09-14',
 'seller_name': None,
 'title': 'Dacia Sandero 0.9 TCe Stepway Prestige',
 'transmission': 'automatic',
 'trim': 'Stepway Prestige',
 'year': 2016}
2026-03-27 12:12:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:12:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TK93788%27 HTTP/1.1" 200 None
2026-03-27 12:12:15 [auto1.nl] INFO: Saving data for TK93788: {'auction_closing_time': 1774629330.0, 'created_time': 1774527036.362748, 'last_price_update_time': 1774613535.972764}
2026-03-27 12:12:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:12:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='TK93788') HTTP/1.1" 204 0
2026-03-27 12:12:15 [auto1.nl] INFO: Found listing with ID: CD92062
2026-03-27 12:12:15 [auto1.nl] INFO: Found listing with ID: GY89787
2026-03-27 12:12:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:12:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GY89787%27 HTTP/1.1" 200 None
2026-03-27 12:12:16 [auto1.nl] INFO: Scrape type for GY89787: 2
2026-03-27 12:12:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b01d01af-7b71-5e80-9de1-9995851d01ef with identifier: GY89787
2026-03-27 12:12:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b01d01af-7b71-5e80-9de1-9995851d01ef with scrape type 2
2026-03-27 12:12:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b01d01af-7b71-5e80-9de1-9995851d01ef with scrape type 2
2026-03-27 12:12:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: b01d01af-7b71-5e80-9de1-9995851d01ef, identifier: GY89787
2026-03-27 12:12:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: b01d01af-7b71-5e80-9de1-9995851d01ef with identifier: GY89787
2026-03-27 12:12:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: b01d01af-7b71-5e80-9de1-9995851d01ef with identifier: GY89787
2026-03-27 12:12:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: b01d01af-7b71-5e80-9de1-9995851d01ef with identifier: GY89787 to the API
2026-03-27 12:12:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 12:12:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 12:12:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 180,
 'expiration_date': '2026-03-27T16:46:21Z',
 'fuel_type': 'petrol',
 'id': 'b01d01af-7b71-5e80-9de1-9995851d01ef',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GY89787',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'V60',
 'odometer': 252042,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-11-14',
 'seller_name': None,
 'title': 'Volvo V60 1.6 T4 R-Design',
 'transmission': 'manual',
 'trim': 'R-Design',
 'year': 2011}
2026-03-27 12:12:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:12:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GY89787%27 HTTP/1.1" 200 None
2026-03-27 12:12:16 [auto1.nl] INFO: Saving data for GY89787: {'auction_closing_time': 1774629981.0, 'created_time': 1773133072.515458, 'last_price_update_time': 1774613536.54075}
2026-03-27 12:12:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:12:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='GY89787') HTTP/1.1" 204 0
2026-03-27 12:12:16 [auto1.nl] INFO: Found listing with ID: HV97203
2026-03-27 12:12:16 [auto1.nl] INFO: Found listing with ID: ES15430
2026-03-27 12:12:16 [auto1.nl] INFO: Found listing with ID: RT28324
2026-03-27 12:12:16 [auto1.nl] INFO: Found listing with ID: DM34469
2026-03-27 12:12:16 [auto1.nl] INFO: Found listing with ID: RS24457
2026-03-27 12:12:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:12:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RS24457%27 HTTP/1.1" 200 None
2026-03-27 12:12:16 [auto1.nl] INFO: Scrape type for RS24457: 2
2026-03-27 12:12:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f736c69f-7aac-502f-8ec8-89d54f694003 with identifier: RS24457
2026-03-27 12:12:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f736c69f-7aac-502f-8ec8-89d54f694003 with scrape type 2
2026-03-27 12:12:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f736c69f-7aac-502f-8ec8-89d54f694003 with scrape type 2
2026-03-27 12:12:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: f736c69f-7aac-502f-8ec8-89d54f694003, identifier: RS24457
2026-03-27 12:12:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: f736c69f-7aac-502f-8ec8-89d54f694003 with identifier: RS24457
2026-03-27 12:12:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: f736c69f-7aac-502f-8ec8-89d54f694003 with identifier: RS24457
2026-03-27 12:12:16 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: f736c69f-7aac-502f-8ec8-89d54f694003 with identifier: RS24457 to the API
2026-03-27 12:12:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 12:12:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 12:12:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-27T16:30:45Z',
 'fuel_type': 'petrol',
 'id': 'f736c69f-7aac-502f-8ec8-89d54f694003',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RS24457',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'Yaris',
 'odometer': 54476,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-01-08',
 'seller_name': None,
 'title': 'Toyota Yaris 1.33 Dual VVT-i Dynamic',
 'transmission': 'manual',
 'trim': 'Dynamic',
 'year': 2012}
2026-03-27 12:12:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:12:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RS24457%27 HTTP/1.1" 200 None
2026-03-27 12:12:16 [auto1.nl] INFO: Saving data for RS24457: {'auction_closing_time': 1774629045.0, 'created_time': 1774527060.166836, 'last_price_update_time': 1774613536.980528}
2026-03-27 12:12:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:12:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='RS24457') HTTP/1.1" 204 0
2026-03-27 12:12:17 [auto1.nl] INFO: Found listing with ID: CP05082
2026-03-27 12:12:17 [auto1.nl] INFO: Found listing with ID: WC97739
2026-03-27 12:12:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:12:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WC97739%27 HTTP/1.1" 200 None
2026-03-27 12:12:17 [auto1.nl] INFO: Scrape type for WC97739: 2
2026-03-27 12:12:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 96f26a86-04a1-54ac-847d-87305f01649e with identifier: WC97739
2026-03-27 12:12:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 96f26a86-04a1-54ac-847d-87305f01649e with scrape type 2
2026-03-27 12:12:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 96f26a86-04a1-54ac-847d-87305f01649e with scrape type 2
2026-03-27 12:12:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 96f26a86-04a1-54ac-847d-87305f01649e, identifier: WC97739
2026-03-27 12:12:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 96f26a86-04a1-54ac-847d-87305f01649e with identifier: WC97739
2026-03-27 12:12:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 96f26a86-04a1-54ac-847d-87305f01649e with identifier: WC97739
2026-03-27 12:12:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 96f26a86-04a1-54ac-847d-87305f01649e with identifier: WC97739 to the API
2026-03-27 12:12:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 12:12:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 12:12:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-27T16:11:47Z',
 'fuel_type': 'petrol',
 'id': '96f26a86-04a1-54ac-847d-87305f01649e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WC97739',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '308',
 'odometer': 123196,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-09-24',
 'seller_name': None,
 'title': 'Peugeot 308 1.2 e-THP Allure',
 'transmission': 'manual',
 'trim': 'Allure',
 'year': 2015}
2026-03-27 12:12:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:12:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WC97739%27 HTTP/1.1" 200 None
2026-03-27 12:12:17 [auto1.nl] INFO: Saving data for WC97739: {'auction_closing_time': 1774627907.0, 'created_time': 1774527070.82757, 'last_price_update_time': 1774613537.394855}
2026-03-27 12:12:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:12:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='WC97739') HTTP/1.1" 204 0
2026-03-27 12:12:17 [auto1.nl] INFO: Found listing with ID: KT14617
2026-03-27 12:12:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:12:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KT14617%27 HTTP/1.1" 200 None
2026-03-27 12:12:17 [auto1.nl] INFO: Scrape type for KT14617: 2
2026-03-27 12:12:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 36eee315-6b97-5bf5-80b6-5c09b7c11ddd with identifier: KT14617
2026-03-27 12:12:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 36eee315-6b97-5bf5-80b6-5c09b7c11ddd with scrape type 2
2026-03-27 12:12:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 36eee315-6b97-5bf5-80b6-5c09b7c11ddd with scrape type 2
2026-03-27 12:12:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 36eee315-6b97-5bf5-80b6-5c09b7c11ddd, identifier: KT14617
2026-03-27 12:12:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 36eee315-6b97-5bf5-80b6-5c09b7c11ddd with identifier: KT14617
2026-03-27 12:12:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 36eee315-6b97-5bf5-80b6-5c09b7c11ddd with identifier: KT14617
2026-03-27 12:12:17 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 36eee315-6b97-5bf5-80b6-5c09b7c11ddd with identifier: KT14617 to the API
2026-03-27 12:12:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 12:12:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 12:12:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 225,
 'expiration_date': '2026-03-27T16:51:21Z',
 'fuel_type': 'petrol',
 'id': '36eee315-6b97-5bf5-80b6-5c09b7c11ddd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KT14617',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Espace',
 'odometer': 67321,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-08-10',
 'seller_name': None,
 'title': 'Renault Espace 1.8 TCe Energy Elysée',
 'transmission': 'automatic',
 'trim': 'Elysée',
 'year': 2017}
2026-03-27 12:12:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:12:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KT14617%27 HTTP/1.1" 200 None
2026-03-27 12:12:17 [auto1.nl] INFO: Saving data for KT14617: {'auction_closing_time': 1774630281.0, 'created_time': 1774527071.753402, 'last_price_update_time': 1774613537.899698}
2026-03-27 12:12:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:12:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='KT14617') HTTP/1.1" 204 0
2026-03-27 12:12:17 [auto1.nl] INFO: Found listing with ID: RY20438
2026-03-27 12:12:17 [auto1.nl] INFO: Found listing with ID: MW16655
2026-03-27 12:12:17 [auto1.nl] INFO: Found listing with ID: FD60498
2026-03-27 12:12:17 [auto1.nl] INFO: Found listing with ID: WZ30415
2026-03-27 12:12:17 [auto1.nl] INFO: Found listing with ID: BC86626
2026-03-27 12:12:17 [auto1.nl] INFO: Found listing with ID: LW83380
2026-03-27 12:12:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:12:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LW83380%27 HTTP/1.1" 200 None
2026-03-27 12:12:17 [auto1.nl] INFO: Scrape type for LW83380: 2
2026-03-27 12:12:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ee7bc88a-fea1-5511-86c4-425a070b6351 with identifier: LW83380
2026-03-27 12:12:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ee7bc88a-fea1-5511-86c4-425a070b6351 with scrape type 2
2026-03-27 12:12:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ee7bc88a-fea1-5511-86c4-425a070b6351 with scrape type 2
2026-03-27 12:12:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: ee7bc88a-fea1-5511-86c4-425a070b6351, identifier: LW83380
2026-03-27 12:12:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: ee7bc88a-fea1-5511-86c4-425a070b6351 with identifier: LW83380
2026-03-27 12:12:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: ee7bc88a-fea1-5511-86c4-425a070b6351 with identifier: LW83380
2026-03-27 12:12:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: ee7bc88a-fea1-5511-86c4-425a070b6351 with identifier: LW83380 to the API
2026-03-27 12:12:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 12:12:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 12:12:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 85,
 'expiration_date': '2026-03-27T16:17:21Z',
 'fuel_type': 'petrol',
 'id': 'ee7bc88a-fea1-5511-86c4-425a070b6351',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LW83380',
 'listing': 'auction',
 'make': 'Alfa Romeo',
 'model': 'MiTo',
 'odometer': 176993,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-06-08',
 'seller_name': None,
 'title': 'Alfa Romeo MiTo 0.9 TwinAir Turismo',
 'transmission': 'manual',
 'trim': 'Turismo',
 'year': 2012}
2026-03-27 12:12:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:12:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LW83380%27 HTTP/1.1" 200 None
2026-03-27 12:12:18 [auto1.nl] INFO: Saving data for LW83380: {'auction_closing_time': 1774628241.0, 'created_time': 1774527063.890731, 'last_price_update_time': 1774613538.270745}
2026-03-27 12:12:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:12:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='LW83380') HTTP/1.1" 204 0
2026-03-27 12:12:18 [auto1.nl] INFO: Found listing with ID: EB25456
2026-03-27 12:12:18 [auto1.nl] INFO: Found listing with ID: YH86497
2026-03-27 12:12:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:12:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YH86497%27 HTTP/1.1" 200 None
2026-03-27 12:12:18 [auto1.nl] INFO: Scrape type for YH86497: 2
2026-03-27 12:12:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 10c4920f-d205-53ee-ab24-4a57e0c2d80b with identifier: YH86497
2026-03-27 12:12:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 10c4920f-d205-53ee-ab24-4a57e0c2d80b with scrape type 2
2026-03-27 12:12:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 10c4920f-d205-53ee-ab24-4a57e0c2d80b with scrape type 2
2026-03-27 12:12:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 10c4920f-d205-53ee-ab24-4a57e0c2d80b, identifier: YH86497
2026-03-27 12:12:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 10c4920f-d205-53ee-ab24-4a57e0c2d80b with identifier: YH86497
2026-03-27 12:12:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 10c4920f-d205-53ee-ab24-4a57e0c2d80b with identifier: YH86497
2026-03-27 12:12:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 10c4920f-d205-53ee-ab24-4a57e0c2d80b with identifier: YH86497 to the API
2026-03-27 12:12:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 12:12:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 12:12:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 120,
 'expiration_date': '2026-03-27T16:33:50Z',
 'fuel_type': 'petrol',
 'id': '10c4920f-d205-53ee-ab24-4a57e0c2d80b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YH86497',
 'listing': 'auction',
 'make': 'Mazda',
 'model': '6',
 'odometer': 232289,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2002-10-17',
 'seller_name': None,
 'title': 'Mazda 6 1.8 CE Sport Combi',
 'transmission': 'manual',
 'trim': 'CE Sport Combi',
 'year': 2002}
2026-03-27 12:12:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:12:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YH86497%27 HTTP/1.1" 200 None
2026-03-27 12:12:18 [auto1.nl] INFO: Saving data for YH86497: {'auction_closing_time': 1774629230.0, 'created_time': 1774527069.856701, 'last_price_update_time': 1774613538.655087}
2026-03-27 12:12:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:12:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='YH86497') HTTP/1.1" 204 0
2026-03-27 12:12:18 [auto1.nl] INFO: Found listing with ID: DR80364
2026-03-27 12:12:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:12:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DR80364%27 HTTP/1.1" 200 None
2026-03-27 12:12:18 [auto1.nl] INFO: Scrape type for DR80364: 2
2026-03-27 12:12:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 76372c59-aea9-5534-9935-d509e271a3fc with identifier: DR80364
2026-03-27 12:12:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 76372c59-aea9-5534-9935-d509e271a3fc with scrape type 2
2026-03-27 12:12:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 76372c59-aea9-5534-9935-d509e271a3fc with scrape type 2
2026-03-27 12:12:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 76372c59-aea9-5534-9935-d509e271a3fc, identifier: DR80364
2026-03-27 12:12:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 76372c59-aea9-5534-9935-d509e271a3fc with identifier: DR80364
2026-03-27 12:12:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 76372c59-aea9-5534-9935-d509e271a3fc with identifier: DR80364
2026-03-27 12:12:18 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 76372c59-aea9-5534-9935-d509e271a3fc with identifier: DR80364 to the API
2026-03-27 12:12:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 12:12:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 12:12:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-27T16:59:58Z',
 'fuel_type': 'petrol',
 'id': '76372c59-aea9-5534-9935-d509e271a3fc',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DR80364',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 198334,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2004-04-15',
 'seller_name': None,
 'title': 'Ford Focus 1.6 Viva',
 'transmission': 'automatic',
 'trim': 'Viva',
 'year': 2004}
2026-03-27 12:12:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:12:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DR80364%27 HTTP/1.1" 200 None
2026-03-27 12:12:19 [auto1.nl] INFO: Saving data for DR80364: {'auction_closing_time': 1774630798.0, 'created_time': 1774527037.239912, 'last_price_update_time': 1774613539.059354}
2026-03-27 12:12:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:12:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='DR80364') HTTP/1.1" 204 0
2026-03-27 12:12:19 [auto1.nl] INFO: Found listing with ID: MD57319
2026-03-27 12:12:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:12:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MD57319%27 HTTP/1.1" 200 None
2026-03-27 12:12:19 [auto1.nl] INFO: Scrape type for MD57319: 2
2026-03-27 12:12:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 32679f86-f323-5b96-9066-2c2a4418452c with identifier: MD57319
2026-03-27 12:12:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 32679f86-f323-5b96-9066-2c2a4418452c with scrape type 2
2026-03-27 12:12:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 32679f86-f323-5b96-9066-2c2a4418452c with scrape type 2
2026-03-27 12:12:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 32679f86-f323-5b96-9066-2c2a4418452c, identifier: MD57319
2026-03-27 12:12:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 32679f86-f323-5b96-9066-2c2a4418452c with identifier: MD57319
2026-03-27 12:12:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 32679f86-f323-5b96-9066-2c2a4418452c with identifier: MD57319
2026-03-27 12:12:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 32679f86-f323-5b96-9066-2c2a4418452c with identifier: MD57319 to the API
2026-03-27 12:12:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 12:12:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 12:12:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 68,
 'expiration_date': '2026-03-27T16:13:13Z',
 'fuel_type': 'petrol',
 'id': '32679f86-f323-5b96-9066-2c2a4418452c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MD57319',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'Aygo',
 'odometer': 78243,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-10-24',
 'seller_name': None,
 'title': 'Toyota Aygo 1.0 Cool',
 'transmission': 'manual',
 'trim': 'Cool',
 'year': 2011}
2026-03-27 12:12:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:12:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MD57319%27 HTTP/1.1" 200 None
2026-03-27 12:12:19 [auto1.nl] INFO: Saving data for MD57319: {'auction_closing_time': 1774627993.0, 'created_time': 1774527034.780978, 'last_price_update_time': 1774613539.466163}
2026-03-27 12:12:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:12:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='MD57319') HTTP/1.1" 204 0
2026-03-27 12:12:19 [auto1.nl] INFO: Found listing with ID: UJ30832
2026-03-27 12:12:19 [auto1.nl] INFO: Found listing with ID: KB59261
2026-03-27 12:12:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:12:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KB59261%27 HTTP/1.1" 200 None
2026-03-27 12:12:19 [auto1.nl] INFO: Scrape type for KB59261: 2
2026-03-27 12:12:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 34f5884b-19d6-5769-8ee9-afca53ae5eb6 with identifier: KB59261
2026-03-27 12:12:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 34f5884b-19d6-5769-8ee9-afca53ae5eb6 with scrape type 2
2026-03-27 12:12:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 34f5884b-19d6-5769-8ee9-afca53ae5eb6 with scrape type 2
2026-03-27 12:12:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 34f5884b-19d6-5769-8ee9-afca53ae5eb6, identifier: KB59261
2026-03-27 12:12:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 34f5884b-19d6-5769-8ee9-afca53ae5eb6 with identifier: KB59261
2026-03-27 12:12:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 34f5884b-19d6-5769-8ee9-afca53ae5eb6 with identifier: KB59261
2026-03-27 12:12:19 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 34f5884b-19d6-5769-8ee9-afca53ae5eb6 with identifier: KB59261 to the API
2026-03-27 12:12:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 12:12:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 12:12:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 136,
 'expiration_date': '2026-03-27T16:51:51Z',
 'fuel_type': 'petrol',
 'id': '34f5884b-19d6-5769-8ee9-afca53ae5eb6',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KB59261',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'A-Klasse',
 'odometer': 139006,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-05-31',
 'seller_name': None,
 'title': 'Mercedes-Benz A-Klasse A 180 AMG Line',
 'transmission': 'automatic',
 'trim': 'AMG Line',
 'year': 2019}
2026-03-27 12:12:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:12:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KB59261%27 HTTP/1.1" 200 None
2026-03-27 12:12:19 [auto1.nl] INFO: Saving data for KB59261: {'auction_closing_time': 1774630311.0, 'created_time': 1774527030.607707, 'last_price_update_time': 1774613539.943051}
2026-03-27 12:12:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:12:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='KB59261') HTTP/1.1" 204 0
2026-03-27 12:12:19 [auto1.nl] INFO: Found listing with ID: KK56723
2026-03-27 12:12:19 [auto1.nl] INFO: Found listing with ID: ZX00670
2026-03-27 12:12:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:12:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZX00670%27 HTTP/1.1" 200 None
2026-03-27 12:12:19 [auto1.nl] INFO: Scrape type for ZX00670: 2
2026-03-27 12:12:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 09fb35d5-3846-5eec-80ae-148ce1f277a3 with identifier: ZX00670
2026-03-27 12:12:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 09fb35d5-3846-5eec-80ae-148ce1f277a3 with scrape type 2
2026-03-27 12:12:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 09fb35d5-3846-5eec-80ae-148ce1f277a3 with scrape type 2
2026-03-27 12:12:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 09fb35d5-3846-5eec-80ae-148ce1f277a3, identifier: ZX00670
2026-03-27 12:12:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 09fb35d5-3846-5eec-80ae-148ce1f277a3 with identifier: ZX00670
2026-03-27 12:12:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 09fb35d5-3846-5eec-80ae-148ce1f277a3 with identifier: ZX00670
2026-03-27 12:12:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 09fb35d5-3846-5eec-80ae-148ce1f277a3 with identifier: ZX00670 to the API
2026-03-27 12:12:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 12:12:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 12:12:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 82,
 'expiration_date': '2026-03-27T16:03:03Z',
 'fuel_type': 'petrol',
 'id': '09fb35d5-3846-5eec-80ae-148ce1f277a3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/ZX00670',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '2008',
 'odometer': 104119,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-03-07',
 'seller_name': None,
 'title': 'Peugeot 2008 1.2 VTi Allure',
 'transmission': 'manual',
 'trim': 'Allure',
 'year': 2014}
2026-03-27 12:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27ZX00670%27 HTTP/1.1" 200 None
2026-03-27 12:12:20 [auto1.nl] INFO: Saving data for ZX00670: {'auction_closing_time': 1774627383.0, 'created_time': 1774527030.190597, 'last_price_update_time': 1774613540.324736}
2026-03-27 12:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='ZX00670') HTTP/1.1" 204 0
2026-03-27 12:12:20 [auto1.nl] INFO: Found listing with ID: BB44396
2026-03-27 12:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BB44396%27 HTTP/1.1" 200 None
2026-03-27 12:12:20 [auto1.nl] INFO: Scrape type for BB44396: 2
2026-03-27 12:12:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e7743db7-10aa-52b4-ab25-5bdb635ae787 with identifier: BB44396
2026-03-27 12:12:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e7743db7-10aa-52b4-ab25-5bdb635ae787 with scrape type 2
2026-03-27 12:12:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e7743db7-10aa-52b4-ab25-5bdb635ae787 with scrape type 2
2026-03-27 12:12:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: e7743db7-10aa-52b4-ab25-5bdb635ae787, identifier: BB44396
2026-03-27 12:12:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: e7743db7-10aa-52b4-ab25-5bdb635ae787 with identifier: BB44396
2026-03-27 12:12:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: e7743db7-10aa-52b4-ab25-5bdb635ae787 with identifier: BB44396
2026-03-27 12:12:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: e7743db7-10aa-52b4-ab25-5bdb635ae787 with identifier: BB44396 to the API
2026-03-27 12:12:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 12:12:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 12:12:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 72,
 'expiration_date': '2026-03-27T16:03:11Z',
 'fuel_type': 'petrol',
 'id': 'e7743db7-10aa-52b4-ab25-5bdb635ae787',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BB44396',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'Aygo',
 'odometer': 100378,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-09-24',
 'seller_name': None,
 'title': 'Toyota Aygo 1.0-VVT-i X',
 'transmission': 'manual',
 'trim': 'X',
 'year': 2019}
2026-03-27 12:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BB44396%27 HTTP/1.1" 200 None
2026-03-27 12:12:20 [auto1.nl] INFO: Saving data for BB44396: {'auction_closing_time': 1774627391.0, 'created_time': 1774527029.748156, 'last_price_update_time': 1774613540.709713}
2026-03-27 12:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='BB44396') HTTP/1.1" 204 0
2026-03-27 12:12:20 [auto1.nl] INFO: Found listing with ID: CP17463
2026-03-27 12:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CP17463%27 HTTP/1.1" 200 None
2026-03-27 12:12:20 [auto1.nl] INFO: Scrape type for CP17463: 2
2026-03-27 12:12:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7d8c1458-b76f-53bf-a51d-32c1a8a1c61e with identifier: CP17463
2026-03-27 12:12:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7d8c1458-b76f-53bf-a51d-32c1a8a1c61e with scrape type 2
2026-03-27 12:12:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7d8c1458-b76f-53bf-a51d-32c1a8a1c61e with scrape type 2
2026-03-27 12:12:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 7d8c1458-b76f-53bf-a51d-32c1a8a1c61e, identifier: CP17463
2026-03-27 12:12:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 7d8c1458-b76f-53bf-a51d-32c1a8a1c61e with identifier: CP17463
2026-03-27 12:12:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 7d8c1458-b76f-53bf-a51d-32c1a8a1c61e with identifier: CP17463
2026-03-27 12:12:20 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 7d8c1458-b76f-53bf-a51d-32c1a8a1c61e with identifier: CP17463 to the API
2026-03-27 12:12:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 12:12:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 12:12:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-27T16:20:07Z',
 'fuel_type': 'petrol',
 'id': '7d8c1458-b76f-53bf-a51d-32c1a8a1c61e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CP17463',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'B-Max',
 'odometer': 67884,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-08-06',
 'seller_name': None,
 'title': 'Ford B-Max 1.6 Ti-VCT Titanium',
 'transmission': 'automatic',
 'trim': 'Titanium',
 'year': 2013}
2026-03-27 12:12:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:12:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CP17463%27 HTTP/1.1" 200 None
2026-03-27 12:12:21 [auto1.nl] INFO: Saving data for CP17463: {'auction_closing_time': 1774628407.0, 'created_time': 1774527050.199928, 'last_price_update_time': 1774613541.111723}
2026-03-27 12:12:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:12:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='CP17463') HTTP/1.1" 204 0
2026-03-27 12:12:21 [auto1.nl] INFO: Found listing with ID: RC67109
2026-03-27 12:12:21 [auto1.nl] INFO: Found listing with ID: HS95271
2026-03-27 12:12:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:12:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HS95271%27 HTTP/1.1" 200 None
2026-03-27 12:12:21 [auto1.nl] INFO: Scrape type for HS95271: 0
2026-03-27 12:12:21 [auto1.nl] INFO: Found listing with ID: FR87941
2026-03-27 12:12:21 [auto1.nl] INFO: Found listing with ID: DF82688
2026-03-27 12:12:21 [auto1.nl] INFO: Found listing with ID: SG32295
2026-03-27 12:12:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:12:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SG32295%27 HTTP/1.1" 200 None
2026-03-27 12:12:21 [auto1.nl] INFO: Scrape type for SG32295: 2
2026-03-27 12:12:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a15bdf39-e115-550b-ae6a-5b61e2f7917b with identifier: SG32295
2026-03-27 12:12:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a15bdf39-e115-550b-ae6a-5b61e2f7917b with scrape type 2
2026-03-27 12:12:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a15bdf39-e115-550b-ae6a-5b61e2f7917b with scrape type 2
2026-03-27 12:12:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: a15bdf39-e115-550b-ae6a-5b61e2f7917b, identifier: SG32295
2026-03-27 12:12:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: a15bdf39-e115-550b-ae6a-5b61e2f7917b with identifier: SG32295
2026-03-27 12:12:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: a15bdf39-e115-550b-ae6a-5b61e2f7917b with identifier: SG32295
2026-03-27 12:12:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: a15bdf39-e115-550b-ae6a-5b61e2f7917b with identifier: SG32295 to the API
2026-03-27 12:12:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 12:12:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 12:12:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 230,
 'expiration_date': '2026-03-27T16:05:13Z',
 'fuel_type': 'diesel',
 'id': 'a15bdf39-e115-550b-ae6a-5b61e2f7917b',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SG32295',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GLK-Klasse',
 'odometer': 256398,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-06-17',
 'seller_name': None,
 'title': 'Mercedes-Benz GLK-Klasse GLK 350 CDI 4Matic',
 'transmission': 'automatic',
 'trim': '4Matic',
 'year': 2010}
2026-03-27 12:12:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:12:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SG32295%27 HTTP/1.1" 200 None
2026-03-27 12:12:21 [auto1.nl] INFO: Saving data for SG32295: {'auction_closing_time': 1774627513.0, 'created_time': 1774527073.68788, 'last_price_update_time': 1774613541.521451}
2026-03-27 12:12:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:12:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='SG32295') HTTP/1.1" 204 0
2026-03-27 12:12:21 [auto1.nl] INFO: Found listing with ID: UD70514
2026-03-27 12:12:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:12:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UD70514%27 HTTP/1.1" 200 None
2026-03-27 12:12:21 [auto1.nl] INFO: Scrape type for UD70514: 2
2026-03-27 12:12:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ed7e1c09-fe1c-5c9f-991f-b97a29a7a600 with identifier: UD70514
2026-03-27 12:12:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ed7e1c09-fe1c-5c9f-991f-b97a29a7a600 with scrape type 2
2026-03-27 12:12:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ed7e1c09-fe1c-5c9f-991f-b97a29a7a600 with scrape type 2
2026-03-27 12:12:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: ed7e1c09-fe1c-5c9f-991f-b97a29a7a600, identifier: UD70514
2026-03-27 12:12:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: ed7e1c09-fe1c-5c9f-991f-b97a29a7a600 with identifier: UD70514
2026-03-27 12:12:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: ed7e1c09-fe1c-5c9f-991f-b97a29a7a600 with identifier: UD70514
2026-03-27 12:12:21 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: ed7e1c09-fe1c-5c9f-991f-b97a29a7a600 with identifier: UD70514 to the API
2026-03-27 12:12:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 12:12:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 12:12:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 72,
 'expiration_date': '2026-03-27T16:38:50Z',
 'fuel_type': 'petrol',
 'id': 'ed7e1c09-fe1c-5c9f-991f-b97a29a7a600',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UD70514',
 'listing': 'auction',
 'make': 'Citroen',
 'model': 'C1',
 'odometer': 65805,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-12-29',
 'seller_name': None,
 'title': 'Citroen C1 1.0 VTi Shine',
 'transmission': 'manual',
 'trim': 'Shine',
 'year': 2020}
2026-03-27 12:12:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:12:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UD70514%27 HTTP/1.1" 200 None
2026-03-27 12:12:21 [auto1.nl] INFO: Saving data for UD70514: {'auction_closing_time': 1774629530.0, 'created_time': 1774527092.947481, 'last_price_update_time': 1774613541.998393}
2026-03-27 12:12:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:12:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='UD70514') HTTP/1.1" 204 0
2026-03-27 12:12:22 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 12:12:22 [auto1.nl] INFO: Channel: 24h | Page: 25 | totalHits: 1061 | hits on page: 40
2026-03-27 12:12:22 [auto1.nl] INFO: Found listing with ID: UD70514
2026-03-27 12:12:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:12:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UD70514%27 HTTP/1.1" 200 None
2026-03-27 12:12:22 [auto1.nl] INFO: Scrape type for UD70514: 0
2026-03-27 12:12:22 [auto1.nl] INFO: Found listing with ID: PU27111
2026-03-27 12:12:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:12:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PU27111%27 HTTP/1.1" 200 None
2026-03-27 12:12:22 [auto1.nl] INFO: Scrape type for PU27111: 2
2026-03-27 12:12:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 24002d7d-366e-54b7-bc2d-8df145edd940 with identifier: PU27111
2026-03-27 12:12:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 24002d7d-366e-54b7-bc2d-8df145edd940 with scrape type 2
2026-03-27 12:12:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 24002d7d-366e-54b7-bc2d-8df145edd940 with scrape type 2
2026-03-27 12:12:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 24002d7d-366e-54b7-bc2d-8df145edd940, identifier: PU27111
2026-03-27 12:12:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 24002d7d-366e-54b7-bc2d-8df145edd940 with identifier: PU27111
2026-03-27 12:12:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 24002d7d-366e-54b7-bc2d-8df145edd940 with identifier: PU27111
2026-03-27 12:12:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 24002d7d-366e-54b7-bc2d-8df145edd940 with identifier: PU27111 to the API
2026-03-27 12:12:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 12:12:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 12:12:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 163,
 'expiration_date': '2026-03-27T16:13:19Z',
 'fuel_type': 'petrol',
 'id': '24002d7d-366e-54b7-bc2d-8df145edd940',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/PU27111',
 'listing': 'auction',
 'make': 'Nissan',
 'model': 'X-Trail',
 'odometer': 190272,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-04-19',
 'seller_name': None,
 'title': 'Nissan X-Trail 1.6 N-Connecta',
 'transmission': 'manual',
 'trim': 'N-Connecta',
 'year': 2018}
2026-03-27 12:12:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:12:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27PU27111%27 HTTP/1.1" 200 None
2026-03-27 12:12:22 [auto1.nl] INFO: Saving data for PU27111: {'auction_closing_time': 1774627999.0, 'created_time': 1774354594.942365, 'last_price_update_time': 1774613542.52949}
2026-03-27 12:12:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:12:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='PU27111') HTTP/1.1" 204 0
2026-03-27 12:12:22 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 12:12:22 [auto1.nl] INFO: Found listing with ID: JP85458
2026-03-27 12:12:22 [auto1.nl] INFO: Found listing with ID: DU11939
2026-03-27 12:12:22 [auto1.nl] INFO: Found listing with ID: RF40574
2026-03-27 12:12:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:12:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RF40574%27 HTTP/1.1" 200 None
2026-03-27 12:12:22 [auto1.nl] INFO: Scrape type for RF40574: 2
2026-03-27 12:12:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a1834ba9-d138-566c-a76d-c3734918c89d with identifier: RF40574
2026-03-27 12:12:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a1834ba9-d138-566c-a76d-c3734918c89d with scrape type 2
2026-03-27 12:12:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a1834ba9-d138-566c-a76d-c3734918c89d with scrape type 2
2026-03-27 12:12:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: a1834ba9-d138-566c-a76d-c3734918c89d, identifier: RF40574
2026-03-27 12:12:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: a1834ba9-d138-566c-a76d-c3734918c89d with identifier: RF40574
2026-03-27 12:12:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-27 12:12:22 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=gas HTTP/1.1" 200 None
2026-03-27 12:12:22 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-27 12:12:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-27 12:12:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: a1834ba9-d138-566c-a76d-c3734918c89d with identifier: RF40574
2026-03-27 12:12:22 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: a1834ba9-d138-566c-a76d-c3734918c89d with identifier: RF40574 to the API
2026-03-27 12:12:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 12:12:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 12:12:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 85,
 'expiration_date': '2026-03-27T16:40:38Z',
 'fuel_type': 'gas',
 'id': 'a1834ba9-d138-566c-a76d-c3734918c89d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RF40574',
 'listing': 'auction',
 'make': 'Fiat',
 'model': 'Panda',
 'odometer': 175694,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-03-28',
 'seller_name': None,
 'title': 'Fiat Panda 0.9 Easy',
 'transmission': 'manual',
 'trim': 'Easy',
 'year': 2014}
2026-03-27 12:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RF40574%27 HTTP/1.1" 200 None
2026-03-27 12:12:23 [auto1.nl] INFO: Saving data for RF40574: {'auction_closing_time': 1774629638.0, 'created_time': 1774527093.593608, 'last_price_update_time': 1774613543.024374}
2026-03-27 12:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='RF40574') HTTP/1.1" 204 0
2026-03-27 12:12:23 [auto1.nl] INFO: Found listing with ID: MA80468
2026-03-27 12:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MA80468%27 HTTP/1.1" 200 None
2026-03-27 12:12:23 [auto1.nl] INFO: Scrape type for MA80468: 2
2026-03-27 12:12:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d535fad5-df59-53de-8c41-f9c92b082630 with identifier: MA80468
2026-03-27 12:12:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d535fad5-df59-53de-8c41-f9c92b082630 with scrape type 2
2026-03-27 12:12:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d535fad5-df59-53de-8c41-f9c92b082630 with scrape type 2
2026-03-27 12:12:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: d535fad5-df59-53de-8c41-f9c92b082630, identifier: MA80468
2026-03-27 12:12:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: d535fad5-df59-53de-8c41-f9c92b082630 with identifier: MA80468
2026-03-27 12:12:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: d535fad5-df59-53de-8c41-f9c92b082630 with identifier: MA80468
2026-03-27 12:12:23 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: d535fad5-df59-53de-8c41-f9c92b082630 with identifier: MA80468 to the API
2026-03-27 12:12:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 12:12:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 12:12:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 145,
 'expiration_date': '2026-03-27T16:07:38Z',
 'fuel_type': 'petrol',
 'id': 'd535fad5-df59-53de-8c41-f9c92b082630',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MA80468',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 110826,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-01-05',
 'seller_name': None,
 'title': 'Ford Focus 2.0 Ghia',
 'transmission': 'automatic',
 'trim': 'Ghia',
 'year': 2009}
2026-03-27 12:12:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:12:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MA80468%27 HTTP/1.1" 200 None
2026-03-27 12:12:24 [auto1.nl] INFO: Saving data for MA80468: {'auction_closing_time': 1774627658.0, 'created_time': 1774527089.668479, 'last_price_update_time': 1774613544.078863}
2026-03-27 12:12:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:12:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='MA80468') HTTP/1.1" 204 0
2026-03-27 12:12:24 [auto1.nl] INFO: Found listing with ID: TP38124
2026-03-27 12:12:24 [auto1.nl] INFO: Found listing with ID: BW07392
2026-03-27 12:12:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:12:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BW07392%27 HTTP/1.1" 200 None
2026-03-27 12:12:24 [auto1.nl] INFO: Scrape type for BW07392: 2
2026-03-27 12:12:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1b6b32a0-d253-57a6-b5e0-6075ce3ca0a5 with identifier: BW07392
2026-03-27 12:12:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1b6b32a0-d253-57a6-b5e0-6075ce3ca0a5 with scrape type 2
2026-03-27 12:12:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1b6b32a0-d253-57a6-b5e0-6075ce3ca0a5 with scrape type 2
2026-03-27 12:12:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 1b6b32a0-d253-57a6-b5e0-6075ce3ca0a5, identifier: BW07392
2026-03-27 12:12:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 1b6b32a0-d253-57a6-b5e0-6075ce3ca0a5 with identifier: BW07392
2026-03-27 12:12:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 1b6b32a0-d253-57a6-b5e0-6075ce3ca0a5 with identifier: BW07392
2026-03-27 12:12:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 1b6b32a0-d253-57a6-b5e0-6075ce3ca0a5 with identifier: BW07392 to the API
2026-03-27 12:12:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 12:12:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 12:12:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 400,
 'expiration_date': '2026-03-27T16:46:03Z',
 'fuel_type': 'petrol',
 'id': '1b6b32a0-d253-57a6-b5e0-6075ce3ca0a5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BW07392',
 'listing': 'auction',
 'make': 'Audi',
 'model': 'RS 3 Sportback',
 'odometer': 96489,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-05-21',
 'seller_name': None,
 'title': 'Audi RS 3 Sportback 2.5 TFSI quattro',
 'transmission': 'automatic',
 'trim': 'quattro',
 'year': 2019}
2026-03-27 12:12:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:12:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BW07392%27 HTTP/1.1" 200 None
2026-03-27 12:12:24 [auto1.nl] INFO: Saving data for BW07392: {'auction_closing_time': 1774629963.0, 'created_time': 1774527094.887809, 'last_price_update_time': 1774613544.505442}
2026-03-27 12:12:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:12:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='BW07392') HTTP/1.1" 204 0
2026-03-27 12:12:24 [auto1.nl] INFO: Found listing with ID: AY58936
2026-03-27 12:12:24 [auto1.nl] INFO: Found listing with ID: EJ39658
2026-03-27 12:12:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:12:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EJ39658%27 HTTP/1.1" 200 None
2026-03-27 12:12:24 [auto1.nl] INFO: Scrape type for EJ39658: 2
2026-03-27 12:12:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ec0012bf-5658-5926-af3a-c3b123cb3af9 with identifier: EJ39658
2026-03-27 12:12:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ec0012bf-5658-5926-af3a-c3b123cb3af9 with scrape type 2
2026-03-27 12:12:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ec0012bf-5658-5926-af3a-c3b123cb3af9 with scrape type 2
2026-03-27 12:12:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: ec0012bf-5658-5926-af3a-c3b123cb3af9, identifier: EJ39658
2026-03-27 12:12:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: ec0012bf-5658-5926-af3a-c3b123cb3af9 with identifier: EJ39658
2026-03-27 12:12:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: ec0012bf-5658-5926-af3a-c3b123cb3af9 with identifier: EJ39658
2026-03-27 12:12:24 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: ec0012bf-5658-5926-af3a-c3b123cb3af9 with identifier: EJ39658 to the API
2026-03-27 12:12:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 12:12:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 12:12:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-27T16:20:05Z',
 'fuel_type': 'petrol',
 'id': 'ec0012bf-5658-5926-af3a-c3b123cb3af9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EJ39658',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'B-Klasse',
 'odometer': 146441,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-03-30',
 'seller_name': None,
 'title': 'Mercedes-Benz B-Klasse B 180 Urban',
 'transmission': 'automatic',
 'trim': 'Urban',
 'year': 2015}
2026-03-27 12:12:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:12:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EJ39658%27 HTTP/1.1" 200 None
2026-03-27 12:12:24 [auto1.nl] INFO: Saving data for EJ39658: {'auction_closing_time': 1774628405.0, 'created_time': 1774527119.559923, 'last_price_update_time': 1774613544.88933}
2026-03-27 12:12:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:12:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='EJ39658') HTTP/1.1" 204 0
2026-03-27 12:12:24 [auto1.nl] INFO: Found listing with ID: YU72254
2026-03-27 12:12:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:12:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YU72254%27 HTTP/1.1" 200 None
2026-03-27 12:12:25 [auto1.nl] INFO: Scrape type for YU72254: 2
2026-03-27 12:12:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6365c896-4bd3-505e-94cd-3d2a5fefd6d5 with identifier: YU72254
2026-03-27 12:12:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6365c896-4bd3-505e-94cd-3d2a5fefd6d5 with scrape type 2
2026-03-27 12:12:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6365c896-4bd3-505e-94cd-3d2a5fefd6d5 with scrape type 2
2026-03-27 12:12:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 6365c896-4bd3-505e-94cd-3d2a5fefd6d5, identifier: YU72254
2026-03-27 12:12:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 6365c896-4bd3-505e-94cd-3d2a5fefd6d5 with identifier: YU72254
2026-03-27 12:12:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 6365c896-4bd3-505e-94cd-3d2a5fefd6d5 with identifier: YU72254
2026-03-27 12:12:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 6365c896-4bd3-505e-94cd-3d2a5fefd6d5 with identifier: YU72254 to the API
2026-03-27 12:12:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 12:12:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 12:12:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 67,
 'expiration_date': '2026-03-27T16:48:50Z',
 'fuel_type': 'petrol',
 'id': '6365c896-4bd3-505e-94cd-3d2a5fefd6d5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YU72254',
 'listing': 'auction',
 'make': 'Hyundai',
 'model': 'i10',
 'odometer': 180403,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-09-15',
 'seller_name': None,
 'title': 'Hyundai i10 1.1 Classic',
 'transmission': 'manual',
 'trim': 'Classic',
 'year': 2009}
2026-03-27 12:12:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:12:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YU72254%27 HTTP/1.1" 200 None
2026-03-27 12:12:25 [auto1.nl] INFO: Saving data for YU72254: {'auction_closing_time': 1774630130.0, 'created_time': 1774527088.820084, 'last_price_update_time': 1774613545.369367}
2026-03-27 12:12:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:12:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='YU72254') HTTP/1.1" 204 0
2026-03-27 12:12:25 [auto1.nl] INFO: Found listing with ID: LF56220
2026-03-27 12:12:25 [auto1.nl] INFO: Found listing with ID: KB15106
2026-03-27 12:12:25 [auto1.nl] INFO: Found listing with ID: YP25238
2026-03-27 12:12:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:12:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YP25238%27 HTTP/1.1" 200 None
2026-03-27 12:12:25 [auto1.nl] INFO: Scrape type for YP25238: 2
2026-03-27 12:12:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a5709728-0d97-54c9-b0dc-28a10eeef62f with identifier: YP25238
2026-03-27 12:12:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a5709728-0d97-54c9-b0dc-28a10eeef62f with scrape type 2
2026-03-27 12:12:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a5709728-0d97-54c9-b0dc-28a10eeef62f with scrape type 2
2026-03-27 12:12:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: a5709728-0d97-54c9-b0dc-28a10eeef62f, identifier: YP25238
2026-03-27 12:12:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: a5709728-0d97-54c9-b0dc-28a10eeef62f with identifier: YP25238
2026-03-27 12:12:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: a5709728-0d97-54c9-b0dc-28a10eeef62f with identifier: YP25238
2026-03-27 12:12:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: a5709728-0d97-54c9-b0dc-28a10eeef62f with identifier: YP25238 to the API
2026-03-27 12:12:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 12:12:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 12:12:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 182,
 'expiration_date': '2026-03-27T16:59:55Z',
 'fuel_type': 'petrol',
 'id': 'a5709728-0d97-54c9-b0dc-28a10eeef62f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YP25238',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Kuga',
 'odometer': 142860,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-09-22',
 'seller_name': None,
 'title': 'Ford Kuga 1.5 EcoBoost Titanium',
 'transmission': 'automatic',
 'trim': 'Titanium',
 'year': 2015}
2026-03-27 12:12:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:12:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YP25238%27 HTTP/1.1" 200 None
2026-03-27 12:12:25 [auto1.nl] INFO: Saving data for YP25238: {'auction_closing_time': 1774630795.0, 'created_time': 1774527040.493971, 'last_price_update_time': 1774613545.754809}
2026-03-27 12:12:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:12:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='YP25238') HTTP/1.1" 204 0
2026-03-27 12:12:25 [auto1.nl] INFO: Found listing with ID: CM00025
2026-03-27 12:12:25 [auto1.nl] INFO: Found listing with ID: VB13156
2026-03-27 12:12:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:12:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VB13156%27 HTTP/1.1" 200 None
2026-03-27 12:12:25 [auto1.nl] INFO: Scrape type for VB13156: 2
2026-03-27 12:12:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ea329a1a-3c4c-5d10-8e9e-ab41d502d10c with identifier: VB13156
2026-03-27 12:12:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ea329a1a-3c4c-5d10-8e9e-ab41d502d10c with scrape type 2
2026-03-27 12:12:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ea329a1a-3c4c-5d10-8e9e-ab41d502d10c with scrape type 2
2026-03-27 12:12:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: ea329a1a-3c4c-5d10-8e9e-ab41d502d10c, identifier: VB13156
2026-03-27 12:12:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: ea329a1a-3c4c-5d10-8e9e-ab41d502d10c with identifier: VB13156
2026-03-27 12:12:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: ea329a1a-3c4c-5d10-8e9e-ab41d502d10c with identifier: VB13156
2026-03-27 12:12:25 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: ea329a1a-3c4c-5d10-8e9e-ab41d502d10c with identifier: VB13156 to the API
2026-03-27 12:12:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 12:12:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 12:12:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 140,
 'expiration_date': '2026-03-27T16:38:55Z',
 'fuel_type': 'petrol',
 'id': 'ea329a1a-3c4c-5d10-8e9e-ab41d502d10c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VB13156',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 157239,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-04-14',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 1.4 TSI Highline BlueMotion Tech',
 'transmission': 'automatic',
 'trim': 'Highline BlueMotion Tech',
 'year': 2013}
2026-03-27 12:12:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:12:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VB13156%27 HTTP/1.1" 200 None
2026-03-27 12:12:26 [auto1.nl] INFO: Saving data for VB13156: {'auction_closing_time': 1774629535.0, 'created_time': 1774527084.011915, 'last_price_update_time': 1774613546.132781}
2026-03-27 12:12:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:12:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='VB13156') HTTP/1.1" 204 0
2026-03-27 12:12:26 [auto1.nl] INFO: Found listing with ID: JY38775
2026-03-27 12:12:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:12:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JY38775%27 HTTP/1.1" 200 None
2026-03-27 12:12:26 [auto1.nl] INFO: Scrape type for JY38775: 2
2026-03-27 12:12:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a6978750-773e-5347-ba62-14bd5fa63b10 with identifier: JY38775
2026-03-27 12:12:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a6978750-773e-5347-ba62-14bd5fa63b10 with scrape type 2
2026-03-27 12:12:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a6978750-773e-5347-ba62-14bd5fa63b10 with scrape type 2
2026-03-27 12:12:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: a6978750-773e-5347-ba62-14bd5fa63b10, identifier: JY38775
2026-03-27 12:12:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: a6978750-773e-5347-ba62-14bd5fa63b10 with identifier: JY38775
2026-03-27 12:12:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: a6978750-773e-5347-ba62-14bd5fa63b10 with identifier: JY38775
2026-03-27 12:12:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: a6978750-773e-5347-ba62-14bd5fa63b10 with identifier: JY38775 to the API
2026-03-27 12:12:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 12:12:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 12:12:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-27T16:10:32Z',
 'fuel_type': 'petrol',
 'id': 'a6978750-773e-5347-ba62-14bd5fa63b10',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JY38775',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf V',
 'odometer': 183654,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-10-01',
 'seller_name': None,
 'title': 'Volkswagen Golf V 1.4 TSI GT Sport',
 'transmission': 'manual',
 'trim': 'GT Sport',
 'year': 2007}
2026-03-27 12:12:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:12:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JY38775%27 HTTP/1.1" 200 None
2026-03-27 12:12:26 [auto1.nl] INFO: Saving data for JY38775: {'auction_closing_time': 1774627832.0, 'created_time': 1774527086.661781, 'last_price_update_time': 1774613546.613998}
2026-03-27 12:12:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:12:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='JY38775') HTTP/1.1" 204 0
2026-03-27 12:12:26 [auto1.nl] INFO: Found listing with ID: JY48975
2026-03-27 12:12:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:12:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JY48975%27 HTTP/1.1" 200 None
2026-03-27 12:12:26 [auto1.nl] INFO: Scrape type for JY48975: 2
2026-03-27 12:12:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c46a11a4-45e6-56cd-b71b-468d62ff47dd with identifier: JY48975
2026-03-27 12:12:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c46a11a4-45e6-56cd-b71b-468d62ff47dd with scrape type 2
2026-03-27 12:12:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c46a11a4-45e6-56cd-b71b-468d62ff47dd with scrape type 2
2026-03-27 12:12:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: c46a11a4-45e6-56cd-b71b-468d62ff47dd, identifier: JY48975
2026-03-27 12:12:26 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 12:12:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: c46a11a4-45e6-56cd-b71b-468d62ff47dd with identifier: JY48975
2026-03-27 12:12:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: c46a11a4-45e6-56cd-b71b-468d62ff47dd with identifier: JY48975
2026-03-27 12:12:26 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: c46a11a4-45e6-56cd-b71b-468d62ff47dd with identifier: JY48975 to the API
2026-03-27 12:12:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 12:12:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 12:12:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 105,
 'expiration_date': '2026-03-27T16:19:36Z',
 'fuel_type': 'petrol',
 'id': 'c46a11a4-45e6-56cd-b71b-468d62ff47dd',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JY48975',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Roomster',
 'odometer': 130255,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-09-29',
 'seller_name': None,
 'title': 'Skoda Roomster 1.2 TSI Style',
 'transmission': 'automatic',
 'trim': 'Style',
 'year': 2011}
2026-03-27 12:12:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:12:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JY48975%27 HTTP/1.1" 200 None
2026-03-27 12:12:27 [auto1.nl] INFO: Saving data for JY48975: {'auction_closing_time': 1774628376.0, 'created_time': 1773925126.877829, 'last_price_update_time': 1774613547.017901}
2026-03-27 12:12:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:12:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='JY48975') HTTP/1.1" 204 0
2026-03-27 12:12:27 [auto1.nl] INFO: Found listing with ID: NS14796
2026-03-27 12:12:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:12:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NS14796%27 HTTP/1.1" 200 None
2026-03-27 12:12:27 [auto1.nl] INFO: Scrape type for NS14796: 2
2026-03-27 12:12:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 74585280-636a-555d-bcd2-59b72e84a7f3 with identifier: NS14796
2026-03-27 12:12:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 74585280-636a-555d-bcd2-59b72e84a7f3 with scrape type 2
2026-03-27 12:12:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 74585280-636a-555d-bcd2-59b72e84a7f3 with scrape type 2
2026-03-27 12:12:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 74585280-636a-555d-bcd2-59b72e84a7f3, identifier: NS14796
2026-03-27 12:12:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 74585280-636a-555d-bcd2-59b72e84a7f3 with identifier: NS14796
2026-03-27 12:12:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 74585280-636a-555d-bcd2-59b72e84a7f3 with identifier: NS14796
2026-03-27 12:12:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 74585280-636a-555d-bcd2-59b72e84a7f3 with identifier: NS14796 to the API
2026-03-27 12:12:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 12:12:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 12:12:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'brown',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 192,
 'expiration_date': '2026-03-27T16:00:40Z',
 'fuel_type': 'petrol',
 'id': '74585280-636a-555d-bcd2-59b72e84a7f3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/NS14796',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X1',
 'odometer': 230910,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-07-13',
 'seller_name': None,
 'title': 'BMW X1 sDrive 20i',
 'transmission': 'automatic',
 'trim': '',
 'year': 2018}
2026-03-27 12:12:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:12:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27NS14796%27 HTTP/1.1" 200 None
2026-03-27 12:12:27 [auto1.nl] INFO: Saving data for NS14796: {'auction_closing_time': 1774627240.0, 'created_time': 1774527048.403402, 'last_price_update_time': 1774613547.471388}
2026-03-27 12:12:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:12:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='NS14796') HTTP/1.1" 204 0
2026-03-27 12:12:27 [auto1.nl] INFO: Found listing with ID: FC33520
2026-03-27 12:12:27 [auto1.nl] INFO: Found listing with ID: MD55137
2026-03-27 12:12:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:12:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MD55137%27 HTTP/1.1" 200 None
2026-03-27 12:12:27 [auto1.nl] INFO: Scrape type for MD55137: 2
2026-03-27 12:12:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d2a92613-fb03-5e07-94a5-f24ca2302e7e with identifier: MD55137
2026-03-27 12:12:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d2a92613-fb03-5e07-94a5-f24ca2302e7e with scrape type 2
2026-03-27 12:12:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d2a92613-fb03-5e07-94a5-f24ca2302e7e with scrape type 2
2026-03-27 12:12:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: d2a92613-fb03-5e07-94a5-f24ca2302e7e, identifier: MD55137
2026-03-27 12:12:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: d2a92613-fb03-5e07-94a5-f24ca2302e7e with identifier: MD55137
2026-03-27 12:12:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: d2a92613-fb03-5e07-94a5-f24ca2302e7e with identifier: MD55137
2026-03-27 12:12:27 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: d2a92613-fb03-5e07-94a5-f24ca2302e7e with identifier: MD55137 to the API
2026-03-27 12:12:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 12:12:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 12:12:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 192,
 'expiration_date': '2026-03-27T16:09:39Z',
 'fuel_type': 'petrol',
 'id': 'd2a92613-fb03-5e07-94a5-f24ca2302e7e',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MD55137',
 'listing': 'auction',
 'make': 'BMW',
 'model': 'X2',
 'odometer': 103056,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-03-07',
 'seller_name': None,
 'title': 'BMW X2 sDrive 20i M Sport',
 'transmission': 'automatic',
 'trim': 'M Sport',
 'year': 2019}
2026-03-27 12:12:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:12:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MD55137%27 HTTP/1.1" 200 None
2026-03-27 12:12:27 [auto1.nl] INFO: Saving data for MD55137: {'auction_closing_time': 1774627779.0, 'created_time': 1774527090.69407, 'last_price_update_time': 1774613547.880548}
2026-03-27 12:12:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:12:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='MD55137') HTTP/1.1" 204 0
2026-03-27 12:12:27 [auto1.nl] INFO: Channel: 24h | Page: 26 | totalHits: 1061 | hits on page: 40
2026-03-27 12:12:27 [auto1.nl] INFO: Found listing with ID: LE78061
2026-03-27 12:12:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:12:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LE78061%27 HTTP/1.1" 200 None
2026-03-27 12:12:28 [auto1.nl] INFO: Scrape type for LE78061: 2
2026-03-27 12:12:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b4784ac2-4b71-5fcc-8e8f-4c1b26f75cb9 with identifier: LE78061
2026-03-27 12:12:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b4784ac2-4b71-5fcc-8e8f-4c1b26f75cb9 with scrape type 2
2026-03-27 12:12:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b4784ac2-4b71-5fcc-8e8f-4c1b26f75cb9 with scrape type 2
2026-03-27 12:12:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: b4784ac2-4b71-5fcc-8e8f-4c1b26f75cb9, identifier: LE78061
2026-03-27 12:12:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: b4784ac2-4b71-5fcc-8e8f-4c1b26f75cb9 with identifier: LE78061
2026-03-27 12:12:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: b4784ac2-4b71-5fcc-8e8f-4c1b26f75cb9 with identifier: LE78061
2026-03-27 12:12:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: b4784ac2-4b71-5fcc-8e8f-4c1b26f75cb9 with identifier: LE78061 to the API
2026-03-27 12:12:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 12:12:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 12:12:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-27T16:04:01Z',
 'fuel_type': 'petrol',
 'id': 'b4784ac2-4b71-5fcc-8e8f-4c1b26f75cb9',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LE78061',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'C-Max',
 'odometer': 58522,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-08-31',
 'seller_name': None,
 'title': 'Ford C-Max 1.0 EcoBoost Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2015}
2026-03-27 12:12:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:12:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LE78061%27 HTTP/1.1" 200 None
2026-03-27 12:12:28 [auto1.nl] INFO: Saving data for LE78061: {'auction_closing_time': 1774627441.0, 'created_time': 1774527077.464881, 'last_price_update_time': 1774613548.410171}
2026-03-27 12:12:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:12:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='LE78061') HTTP/1.1" 204 0
2026-03-27 12:12:28 [auto1.nl] INFO: Found listing with ID: BF56002
2026-03-27 12:12:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:12:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BF56002%27 HTTP/1.1" 200 None
2026-03-27 12:12:28 [auto1.nl] INFO: Scrape type for BF56002: 2
2026-03-27 12:12:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ee42dc12-6f44-5b66-9c45-383983d4f791 with identifier: BF56002
2026-03-27 12:12:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ee42dc12-6f44-5b66-9c45-383983d4f791 with scrape type 2
2026-03-27 12:12:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ee42dc12-6f44-5b66-9c45-383983d4f791 with scrape type 2
2026-03-27 12:12:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: ee42dc12-6f44-5b66-9c45-383983d4f791, identifier: BF56002
2026-03-27 12:12:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 12:12:28 [auto1.nl] INFO: Found listing with ID: VL07732
2026-03-27 12:12:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:12:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VL07732%27 HTTP/1.1" 200 None
2026-03-27 12:12:28 [auto1.nl] INFO: Scrape type for VL07732: 2
2026-03-27 12:12:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f516a972-b818-568f-b830-99740ff1df52 with identifier: VL07732
2026-03-27 12:12:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f516a972-b818-568f-b830-99740ff1df52 with scrape type 2
2026-03-27 12:12:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f516a972-b818-568f-b830-99740ff1df52 with scrape type 2
2026-03-27 12:12:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: f516a972-b818-568f-b830-99740ff1df52, identifier: VL07732
2026-03-27 12:12:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: ee42dc12-6f44-5b66-9c45-383983d4f791 with identifier: BF56002
2026-03-27 12:12:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: ee42dc12-6f44-5b66-9c45-383983d4f791 with identifier: BF56002
2026-03-27 12:12:28 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: ee42dc12-6f44-5b66-9c45-383983d4f791 with identifier: BF56002 to the API
2026-03-27 12:12:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 12:12:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 12:12:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 3,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-27T16:28:34Z',
 'fuel_type': 'petrol',
 'id': 'ee42dc12-6f44-5b66-9c45-383983d4f791',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BF56002',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Fiesta',
 'odometer': 96059,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-10-13',
 'seller_name': None,
 'title': 'Ford Fiesta 1.0 EcoBoost Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2014}
2026-03-27 12:12:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:12:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BF56002%27 HTTP/1.1" 200 None
2026-03-27 12:12:28 [auto1.nl] INFO: Saving data for BF56002: {'auction_closing_time': 1774628914.0, 'created_time': 1774527044.814071, 'last_price_update_time': 1774613548.913026}
2026-03-27 12:12:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:12:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='BF56002') HTTP/1.1" 204 0
2026-03-27 12:12:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: f516a972-b818-568f-b830-99740ff1df52 with identifier: VL07732
2026-03-27 12:12:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: f516a972-b818-568f-b830-99740ff1df52 with identifier: VL07732
2026-03-27 12:12:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: f516a972-b818-568f-b830-99740ff1df52 with identifier: VL07732 to the API
2026-03-27 12:12:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 12:12:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 12:12:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'violet',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 82,
 'expiration_date': '2026-03-27T16:45:47Z',
 'fuel_type': 'petrol',
 'id': 'f516a972-b818-568f-b830-99740ff1df52',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VL07732',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Fiesta',
 'odometer': 246337,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-08-28',
 'seller_name': None,
 'title': 'Ford Fiesta 1.25 Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2008}
2026-03-27 12:12:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:12:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VL07732%27 HTTP/1.1" 200 None
2026-03-27 12:12:29 [auto1.nl] INFO: Saving data for VL07732: {'auction_closing_time': 1774629947.0, 'created_time': 1774527083.562605, 'last_price_update_time': 1774613549.189253}
2026-03-27 12:12:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:12:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='VL07732') HTTP/1.1" 204 0
2026-03-27 12:12:29 [auto1.nl] INFO: Found listing with ID: JG46150
2026-03-27 12:12:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:12:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JG46150%27 HTTP/1.1" 200 None
2026-03-27 12:12:29 [auto1.nl] INFO: Scrape type for JG46150: 2
2026-03-27 12:12:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9877e3e3-9d23-5e32-80a3-17af76d5c40c with identifier: JG46150
2026-03-27 12:12:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9877e3e3-9d23-5e32-80a3-17af76d5c40c with scrape type 2
2026-03-27 12:12:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9877e3e3-9d23-5e32-80a3-17af76d5c40c with scrape type 2
2026-03-27 12:12:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 9877e3e3-9d23-5e32-80a3-17af76d5c40c, identifier: JG46150
2026-03-27 12:12:29 [auto1.nl] INFO: Found listing with ID: HT85176
2026-03-27 12:12:29 [auto1.nl] INFO: Found listing with ID: GD46513
2026-03-27 12:12:29 [auto1.nl] INFO: Found listing with ID: BD71761
2026-03-27 12:12:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:12:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BD71761%27 HTTP/1.1" 200 None
2026-03-27 12:12:29 [auto1.nl] INFO: Scrape type for BD71761: 2
2026-03-27 12:12:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ddb44da9-2d11-579a-a4d4-cac80e58c4de with identifier: BD71761
2026-03-27 12:12:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ddb44da9-2d11-579a-a4d4-cac80e58c4de with scrape type 2
2026-03-27 12:12:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ddb44da9-2d11-579a-a4d4-cac80e58c4de with scrape type 2
2026-03-27 12:12:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: ddb44da9-2d11-579a-a4d4-cac80e58c4de, identifier: BD71761
2026-03-27 12:12:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 9877e3e3-9d23-5e32-80a3-17af76d5c40c with identifier: JG46150
2026-03-27 12:12:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 9877e3e3-9d23-5e32-80a3-17af76d5c40c with identifier: JG46150
2026-03-27 12:12:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 9877e3e3-9d23-5e32-80a3-17af76d5c40c with identifier: JG46150 to the API
2026-03-27 12:12:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 12:12:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 12:12:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-27T16:38:57Z',
 'fuel_type': 'diesel',
 'id': '9877e3e3-9d23-5e32-80a3-17af76d5c40c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JG46150',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Kangoo',
 'odometer': 321308,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2009-11-04',
 'seller_name': None,
 'title': 'Renault Kangoo 1.5 dCi Expression',
 'transmission': 'manual',
 'trim': 'Expression',
 'year': 2009}
2026-03-27 12:12:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:12:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JG46150%27 HTTP/1.1" 200 None
2026-03-27 12:12:29 [auto1.nl] INFO: Saving data for JG46150: {'auction_closing_time': 1774629537.0, 'created_time': 1774008646.275382, 'last_price_update_time': 1774613549.685745}
2026-03-27 12:12:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:12:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='JG46150') HTTP/1.1" 204 0
2026-03-27 12:12:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: ddb44da9-2d11-579a-a4d4-cac80e58c4de with identifier: BD71761
2026-03-27 12:12:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: ddb44da9-2d11-579a-a4d4-cac80e58c4de with identifier: BD71761
2026-03-27 12:12:29 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: ddb44da9-2d11-579a-a4d4-cac80e58c4de with identifier: BD71761 to the API
2026-03-27 12:12:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 12:12:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 12:12:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-27T16:18:54Z',
 'fuel_type': 'petrol',
 'id': 'ddb44da9-2d11-579a-a4d4-cac80e58c4de',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BD71761',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Kadjar',
 'odometer': 119820,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-11-30',
 'seller_name': None,
 'title': 'Renault Kadjar 1.2 TCe Energy Black Edition',
 'transmission': 'manual',
 'trim': 'Black Edition',
 'year': 2016}
2026-03-27 12:12:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:12:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BD71761%27 HTTP/1.1" 200 None
2026-03-27 12:12:29 [auto1.nl] INFO: Saving data for BD71761: {'auction_closing_time': 1774628334.0, 'created_time': 1774527076.614913, 'last_price_update_time': 1774613549.971688}
2026-03-27 12:12:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:12:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='BD71761') HTTP/1.1" 204 0
2026-03-27 12:12:29 [auto1.nl] INFO: Found listing with ID: MR73967
2026-03-27 12:12:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:12:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MR73967%27 HTTP/1.1" 200 None
2026-03-27 12:12:30 [auto1.nl] INFO: Scrape type for MR73967: 2
2026-03-27 12:12:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d2cbb42c-8faf-56ac-900a-7beba7154dac with identifier: MR73967
2026-03-27 12:12:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d2cbb42c-8faf-56ac-900a-7beba7154dac with scrape type 2
2026-03-27 12:12:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d2cbb42c-8faf-56ac-900a-7beba7154dac with scrape type 2
2026-03-27 12:12:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: d2cbb42c-8faf-56ac-900a-7beba7154dac, identifier: MR73967
2026-03-27 12:12:30 [auto1.nl] INFO: Found listing with ID: WJ55319
2026-03-27 12:12:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:12:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WJ55319%27 HTTP/1.1" 200 None
2026-03-27 12:12:30 [auto1.nl] INFO: Scrape type for WJ55319: 2
2026-03-27 12:12:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1e9ea7c4-5e26-5b98-96d5-dfd26e22978f with identifier: WJ55319
2026-03-27 12:12:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1e9ea7c4-5e26-5b98-96d5-dfd26e22978f with scrape type 2
2026-03-27 12:12:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1e9ea7c4-5e26-5b98-96d5-dfd26e22978f with scrape type 2
2026-03-27 12:12:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 1e9ea7c4-5e26-5b98-96d5-dfd26e22978f, identifier: WJ55319
2026-03-27 12:12:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: d2cbb42c-8faf-56ac-900a-7beba7154dac with identifier: MR73967
2026-03-27 12:12:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: d2cbb42c-8faf-56ac-900a-7beba7154dac with identifier: MR73967
2026-03-27 12:12:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: d2cbb42c-8faf-56ac-900a-7beba7154dac with identifier: MR73967 to the API
2026-03-27 12:12:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 12:12:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 12:12:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-27T16:07:29Z',
 'fuel_type': 'diesel',
 'id': 'd2cbb42c-8faf-56ac-900a-7beba7154dac',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MR73967',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Tiguan',
 'odometer': 272668,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-09-30',
 'seller_name': None,
 'title': 'Volkswagen Tiguan 2.0 TDI Carat Edition 4Motion BlueMotion',
 'transmission': 'automatic',
 'trim': 'Carat Edition 4Motion BlueMotion',
 'year': 2016}
2026-03-27 12:12:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:12:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MR73967%27 HTTP/1.1" 200 None
2026-03-27 12:12:30 [auto1.nl] INFO: Saving data for MR73967: {'auction_closing_time': 1774627649.0, 'created_time': 1774527045.893859, 'last_price_update_time': 1774613550.476571}
2026-03-27 12:12:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:12:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='MR73967') HTTP/1.1" 204 0
2026-03-27 12:12:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 1e9ea7c4-5e26-5b98-96d5-dfd26e22978f with identifier: WJ55319
2026-03-27 12:12:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 1e9ea7c4-5e26-5b98-96d5-dfd26e22978f with identifier: WJ55319
2026-03-27 12:12:30 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 1e9ea7c4-5e26-5b98-96d5-dfd26e22978f with identifier: WJ55319 to the API
2026-03-27 12:12:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 12:12:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 12:12:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 165,
 'expiration_date': '2026-03-27T16:27:17Z',
 'fuel_type': 'petrol',
 'id': '1e9ea7c4-5e26-5b98-96d5-dfd26e22978f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WJ55319',
 'listing': 'auction',
 'make': 'Mazda',
 'model': '6',
 'odometer': 222302,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2013-06-26',
 'seller_name': None,
 'title': 'Mazda 6 2.0 Sports-Line',
 'transmission': 'manual',
 'trim': 'Sports-Line',
 'year': 2013}
2026-03-27 12:12:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:12:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WJ55319%27 HTTP/1.1" 200 None
2026-03-27 12:12:30 [auto1.nl] INFO: Saving data for WJ55319: {'auction_closing_time': 1774628837.0, 'created_time': 1774527077.070313, 'last_price_update_time': 1774613550.738367}
2026-03-27 12:12:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:12:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='WJ55319') HTTP/1.1" 204 0
2026-03-27 12:12:30 [auto1.nl] INFO: Found listing with ID: SV01425
2026-03-27 12:12:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:12:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SV01425%27 HTTP/1.1" 200 None
2026-03-27 12:12:30 [auto1.nl] INFO: Scrape type for SV01425: 2
2026-03-27 12:12:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f69f4830-c1b4-5a02-8906-622cadf115a5 with identifier: SV01425
2026-03-27 12:12:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f69f4830-c1b4-5a02-8906-622cadf115a5 with scrape type 2
2026-03-27 12:12:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f69f4830-c1b4-5a02-8906-622cadf115a5 with scrape type 2
2026-03-27 12:12:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: f69f4830-c1b4-5a02-8906-622cadf115a5, identifier: SV01425
2026-03-27 12:12:30 [auto1.nl] INFO: Found listing with ID: LA08041
2026-03-27 12:12:30 [auto1.nl] INFO: Found listing with ID: VA79192
2026-03-27 12:12:30 [auto1.nl] INFO: Found listing with ID: EA94129
2026-03-27 12:12:30 [auto1.nl] INFO: Found listing with ID: KF13201
2026-03-27 12:12:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:12:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KF13201%27 HTTP/1.1" 200 None
2026-03-27 12:12:30 [auto1.nl] INFO: Scrape type for KF13201: 2
2026-03-27 12:12:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f1e792ac-a19c-5e9c-8adf-1ce9340e802f with identifier: KF13201
2026-03-27 12:12:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f1e792ac-a19c-5e9c-8adf-1ce9340e802f with scrape type 2
2026-03-27 12:12:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f1e792ac-a19c-5e9c-8adf-1ce9340e802f with scrape type 2
2026-03-27 12:12:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: f1e792ac-a19c-5e9c-8adf-1ce9340e802f, identifier: KF13201
2026-03-27 12:12:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: f69f4830-c1b4-5a02-8906-622cadf115a5 with identifier: SV01425
2026-03-27 12:12:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: f69f4830-c1b4-5a02-8906-622cadf115a5 with identifier: SV01425
2026-03-27 12:12:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: f69f4830-c1b4-5a02-8906-622cadf115a5 with identifier: SV01425 to the API
2026-03-27 12:12:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 12:12:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 12:12:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 100,
 'expiration_date': '2026-03-27T16:30:09Z',
 'fuel_type': 'petrol',
 'id': 'f69f4830-c1b4-5a02-8906-622cadf115a5',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SV01425',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Fiesta',
 'odometer': 94002,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-07-12',
 'seller_name': None,
 'title': 'Ford Fiesta 1.0 EcoBoost ST-Line',
 'transmission': 'manual',
 'trim': 'ST-Line',
 'year': 2017}
2026-03-27 12:12:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:12:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SV01425%27 HTTP/1.1" 200 None
2026-03-27 12:12:31 [auto1.nl] INFO: Saving data for SV01425: {'auction_closing_time': 1774629009.0, 'created_time': 1774527053.631373, 'last_price_update_time': 1774613551.583641}
2026-03-27 12:12:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:12:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='SV01425') HTTP/1.1" 204 0
2026-03-27 12:12:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: f1e792ac-a19c-5e9c-8adf-1ce9340e802f with identifier: KF13201
2026-03-27 12:12:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: f1e792ac-a19c-5e9c-8adf-1ce9340e802f with identifier: KF13201
2026-03-27 12:12:31 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: f1e792ac-a19c-5e9c-8adf-1ce9340e802f with identifier: KF13201 to the API
2026-03-27 12:12:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 12:12:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 12:12:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-27T16:02:22Z',
 'fuel_type': 'petrol',
 'id': 'f1e792ac-a19c-5e9c-8adf-1ce9340e802f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KF13201',
 'listing': 'auction',
 'make': 'Skoda',
 'model': 'Octavia',
 'odometer': 180480,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-09-02',
 'seller_name': None,
 'title': 'Skoda Octavia 1.5 TSI ACT Ambition',
 'transmission': 'automatic',
 'trim': 'Ambition',
 'year': 2020}
2026-03-27 12:12:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:12:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KF13201%27 HTTP/1.1" 200 None
2026-03-27 12:12:32 [auto1.nl] INFO: Saving data for KF13201: {'auction_closing_time': 1774627342.0, 'created_time': 1773134976.957302, 'last_price_update_time': 1774613552.054566}
2026-03-27 12:12:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:12:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='KF13201') HTTP/1.1" 204 0
2026-03-27 12:12:32 [auto1.nl] INFO: Found listing with ID: DG73581
2026-03-27 12:12:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:12:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DG73581%27 HTTP/1.1" 200 None
2026-03-27 12:12:32 [auto1.nl] INFO: Scrape type for DG73581: 2
2026-03-27 12:12:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 61ca7538-84f7-5f0b-a3bc-9cdff76072e7 with identifier: DG73581
2026-03-27 12:12:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 61ca7538-84f7-5f0b-a3bc-9cdff76072e7 with scrape type 2
2026-03-27 12:12:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 61ca7538-84f7-5f0b-a3bc-9cdff76072e7 with scrape type 2
2026-03-27 12:12:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 61ca7538-84f7-5f0b-a3bc-9cdff76072e7, identifier: DG73581
2026-03-27 12:12:32 [auto1.nl] INFO: Found listing with ID: MP21910
2026-03-27 12:12:32 [auto1.nl] INFO: Found listing with ID: AY18274
2026-03-27 12:12:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:12:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AY18274%27 HTTP/1.1" 200 None
2026-03-27 12:12:32 [auto1.nl] INFO: Scrape type for AY18274: 2
2026-03-27 12:12:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6d95024c-6087-579a-a9fd-9d0edffb3348 with identifier: AY18274
2026-03-27 12:12:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6d95024c-6087-579a-a9fd-9d0edffb3348 with scrape type 2
2026-03-27 12:12:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6d95024c-6087-579a-a9fd-9d0edffb3348 with scrape type 2
2026-03-27 12:12:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 6d95024c-6087-579a-a9fd-9d0edffb3348, identifier: AY18274
2026-03-27 12:12:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 61ca7538-84f7-5f0b-a3bc-9cdff76072e7 with identifier: DG73581
2026-03-27 12:12:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 61ca7538-84f7-5f0b-a3bc-9cdff76072e7 with identifier: DG73581
2026-03-27 12:12:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 61ca7538-84f7-5f0b-a3bc-9cdff76072e7 with identifier: DG73581 to the API
2026-03-27 12:12:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 12:12:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 12:12:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-27T16:24:23Z',
 'fuel_type': 'petrol',
 'id': '61ca7538-84f7-5f0b-a3bc-9cdff76072e7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DG73581',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '206',
 'odometer': 173245,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2005-04-05',
 'seller_name': None,
 'title': 'Peugeot 206 1.4 Style',
 'transmission': 'manual',
 'trim': 'Style',
 'year': 2005}
2026-03-27 12:12:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:12:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DG73581%27 HTTP/1.1" 200 None
2026-03-27 12:12:32 [auto1.nl] INFO: Saving data for DG73581: {'auction_closing_time': 1774628663.0, 'created_time': 1774034009.626346, 'last_price_update_time': 1774613552.551733}
2026-03-27 12:12:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:12:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='DG73581') HTTP/1.1" 204 0
2026-03-27 12:12:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 6d95024c-6087-579a-a9fd-9d0edffb3348 with identifier: AY18274
2026-03-27 12:12:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 6d95024c-6087-579a-a9fd-9d0edffb3348 with identifier: AY18274
2026-03-27 12:12:32 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 6d95024c-6087-579a-a9fd-9d0edffb3348 with identifier: AY18274 to the API
2026-03-27 12:12:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 12:12:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 12:12:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 230,
 'expiration_date': '2026-03-27T16:44:09Z',
 'fuel_type': 'diesel',
 'id': '6d95024c-6087-579a-a9fd-9d0edffb3348',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AY18274',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'GLK-Klasse',
 'odometer': 188179,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-05-12',
 'seller_name': None,
 'title': 'Mercedes-Benz GLK-Klasse GLK 350 CDI 4Matic',
 'transmission': 'automatic',
 'trim': '4Matic',
 'year': 2011}
2026-03-27 12:12:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:12:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AY18274%27 HTTP/1.1" 200 None
2026-03-27 12:12:32 [auto1.nl] INFO: Saving data for AY18274: {'auction_closing_time': 1774629849.0, 'created_time': 1774008644.757678, 'last_price_update_time': 1774613552.843606}
2026-03-27 12:12:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:12:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='AY18274') HTTP/1.1" 204 0
2026-03-27 12:12:32 [auto1.nl] INFO: Found listing with ID: WL71666
2026-03-27 12:12:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:12:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WL71666%27 HTTP/1.1" 200 None
2026-03-27 12:12:32 [auto1.nl] INFO: Scrape type for WL71666: 2
2026-03-27 12:12:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f1a5d592-41f4-5848-9eca-8229df382afe with identifier: WL71666
2026-03-27 12:12:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f1a5d592-41f4-5848-9eca-8229df382afe with scrape type 2
2026-03-27 12:12:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f1a5d592-41f4-5848-9eca-8229df382afe with scrape type 2
2026-03-27 12:12:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: f1a5d592-41f4-5848-9eca-8229df382afe, identifier: WL71666
2026-03-27 12:12:32 [auto1.nl] INFO: Found listing with ID: XY00413
2026-03-27 12:12:32 [auto1.nl] INFO: Found listing with ID: LR97495
2026-03-27 12:12:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:12:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LR97495%27 HTTP/1.1" 200 None
2026-03-27 12:12:32 [auto1.nl] INFO: Scrape type for LR97495: 2
2026-03-27 12:12:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a3e97ac8-b648-54e7-a504-ab5f4d5e7435 with identifier: LR97495
2026-03-27 12:12:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a3e97ac8-b648-54e7-a504-ab5f4d5e7435 with scrape type 2
2026-03-27 12:12:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a3e97ac8-b648-54e7-a504-ab5f4d5e7435 with scrape type 2
2026-03-27 12:12:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: a3e97ac8-b648-54e7-a504-ab5f4d5e7435, identifier: LR97495
2026-03-27 12:12:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: f1a5d592-41f4-5848-9eca-8229df382afe with identifier: WL71666
2026-03-27 12:12:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: f1a5d592-41f4-5848-9eca-8229df382afe with identifier: WL71666
2026-03-27 12:12:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: f1a5d592-41f4-5848-9eca-8229df382afe with identifier: WL71666 to the API
2026-03-27 12:12:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 12:12:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 12:12:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 145,
 'expiration_date': '2026-03-27T16:31:39Z',
 'fuel_type': 'petrol',
 'id': 'f1a5d592-41f4-5848-9eca-8229df382afe',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/WL71666',
 'listing': 'auction',
 'make': 'Volvo',
 'model': 'V70',
 'odometer': 219168,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2008-03-19',
 'seller_name': None,
 'title': 'Volvo V70 2.0 Kinetic',
 'transmission': 'manual',
 'trim': 'Kinetic',
 'year': 2008}
2026-03-27 12:12:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:12:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27WL71666%27 HTTP/1.1" 200 None
2026-03-27 12:12:33 [auto1.nl] INFO: Saving data for WL71666: {'auction_closing_time': 1774629099.0, 'created_time': 1774527052.49243, 'last_price_update_time': 1774613553.335897}
2026-03-27 12:12:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:12:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='WL71666') HTTP/1.1" 204 0
2026-03-27 12:12:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: a3e97ac8-b648-54e7-a504-ab5f4d5e7435 with identifier: LR97495
2026-03-27 12:12:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: a3e97ac8-b648-54e7-a504-ab5f4d5e7435 with identifier: LR97495
2026-03-27 12:12:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: a3e97ac8-b648-54e7-a504-ab5f4d5e7435 with identifier: LR97495 to the API
2026-03-27 12:12:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 12:12:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 12:12:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'green',
 'currency': 'EUR',
 'doors_number': 2,
 'engine_horse_power': 107,
 'expiration_date': '2026-03-27T16:21:53Z',
 'fuel_type': 'petrol',
 'id': 'a3e97ac8-b648-54e7-a504-ab5f4d5e7435',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/LR97495',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Megane',
 'odometer': 89490,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2002-05-28',
 'seller_name': None,
 'title': 'Renault Megane 1.6 Privilege',
 'transmission': 'manual',
 'trim': 'Privilege',
 'year': 2002}
2026-03-27 12:12:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:12:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27LR97495%27 HTTP/1.1" 200 None
2026-03-27 12:12:33 [auto1.nl] INFO: Saving data for LR97495: {'auction_closing_time': 1774628513.0, 'created_time': 1773229353.229175, 'last_price_update_time': 1774613553.612912}
2026-03-27 12:12:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:12:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='LR97495') HTTP/1.1" 204 0
2026-03-27 12:12:33 [auto1.nl] INFO: Found listing with ID: DG66253
2026-03-27 12:12:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:12:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DG66253%27 HTTP/1.1" 200 None
2026-03-27 12:12:33 [auto1.nl] INFO: Scrape type for DG66253: 2
2026-03-27 12:12:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8e8a9c89-27ee-537c-b1cf-a226e6ae2454 with identifier: DG66253
2026-03-27 12:12:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8e8a9c89-27ee-537c-b1cf-a226e6ae2454 with scrape type 2
2026-03-27 12:12:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8e8a9c89-27ee-537c-b1cf-a226e6ae2454 with scrape type 2
2026-03-27 12:12:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 8e8a9c89-27ee-537c-b1cf-a226e6ae2454, identifier: DG66253
2026-03-27 12:12:33 [auto1.nl] INFO: Found listing with ID: CL54405
2026-03-27 12:12:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:12:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CL54405%27 HTTP/1.1" 200 None
2026-03-27 12:12:33 [auto1.nl] INFO: Scrape type for CL54405: 2
2026-03-27 12:12:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 915b7680-b624-52f2-b4e5-980f554a89e1 with identifier: CL54405
2026-03-27 12:12:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 915b7680-b624-52f2-b4e5-980f554a89e1 with scrape type 2
2026-03-27 12:12:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 915b7680-b624-52f2-b4e5-980f554a89e1 with scrape type 2
2026-03-27 12:12:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 915b7680-b624-52f2-b4e5-980f554a89e1, identifier: CL54405
2026-03-27 12:12:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 8e8a9c89-27ee-537c-b1cf-a226e6ae2454 with identifier: DG66253
2026-03-27 12:12:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 8e8a9c89-27ee-537c-b1cf-a226e6ae2454 with identifier: DG66253
2026-03-27 12:12:33 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 8e8a9c89-27ee-537c-b1cf-a226e6ae2454 with identifier: DG66253 to the API
2026-03-27 12:12:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 12:12:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 12:12:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 98,
 'expiration_date': '2026-03-27T16:31:39Z',
 'fuel_type': 'petrol',
 'id': '8e8a9c89-27ee-537c-b1cf-a226e6ae2454',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DG66253',
 'listing': 'auction',
 'make': 'MINI',
 'model': 'Countryman',
 'odometer': 178248,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-06-19',
 'seller_name': None,
 'title': 'MINI Countryman One',
 'transmission': 'manual',
 'trim': '',
 'year': 2011}
2026-03-27 12:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DG66253%27 HTTP/1.1" 200 None
2026-03-27 12:12:34 [auto1.nl] INFO: Saving data for DG66253: {'auction_closing_time': 1774629099.0, 'created_time': 1774527055.729414, 'last_price_update_time': 1774613554.23826}
2026-03-27 12:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='DG66253') HTTP/1.1" 204 0
2026-03-27 12:12:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 915b7680-b624-52f2-b4e5-980f554a89e1 with identifier: CL54405
2026-03-27 12:12:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 915b7680-b624-52f2-b4e5-980f554a89e1 with identifier: CL54405
2026-03-27 12:12:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 915b7680-b624-52f2-b4e5-980f554a89e1 with identifier: CL54405 to the API
2026-03-27 12:12:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 12:12:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 12:12:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-27T16:10:15Z',
 'fuel_type': 'petrol',
 'id': '915b7680-b624-52f2-b4e5-980f554a89e1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/CL54405',
 'listing': 'auction',
 'make': 'Kia',
 'model': 'Soul',
 'odometer': 240816,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-11-09',
 'seller_name': None,
 'title': 'Kia Soul 1.6 Active',
 'transmission': 'manual',
 'trim': 'Active',
 'year': 2010}
2026-03-27 12:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27CL54405%27 HTTP/1.1" 200 None
2026-03-27 12:12:34 [auto1.nl] INFO: Saving data for CL54405: {'auction_closing_time': 1774627815.0, 'created_time': 1774527043.567237, 'last_price_update_time': 1774613554.513327}
2026-03-27 12:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='CL54405') HTTP/1.1" 204 0
2026-03-27 12:12:34 [auto1.nl] INFO: Found listing with ID: BP47777
2026-03-27 12:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BP47777%27 HTTP/1.1" 200 None
2026-03-27 12:12:34 [auto1.nl] INFO: Scrape type for BP47777: 2
2026-03-27 12:12:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b2ae7386-4228-5a9d-81b0-128222f07e91 with identifier: BP47777
2026-03-27 12:12:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b2ae7386-4228-5a9d-81b0-128222f07e91 with scrape type 2
2026-03-27 12:12:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b2ae7386-4228-5a9d-81b0-128222f07e91 with scrape type 2
2026-03-27 12:12:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: b2ae7386-4228-5a9d-81b0-128222f07e91, identifier: BP47777
2026-03-27 12:12:34 [auto1.nl] INFO: Found listing with ID: JT64166
2026-03-27 12:12:34 [auto1.nl] INFO: Found listing with ID: KD04773
2026-03-27 12:12:34 [auto1.nl] INFO: Found listing with ID: SM80467
2026-03-27 12:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SM80467%27 HTTP/1.1" 200 None
2026-03-27 12:12:34 [auto1.nl] INFO: Scrape type for SM80467: 2
2026-03-27 12:12:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3f328af6-a62d-5d37-9d2d-d0a0ad71628c with identifier: SM80467
2026-03-27 12:12:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3f328af6-a62d-5d37-9d2d-d0a0ad71628c with scrape type 2
2026-03-27 12:12:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3f328af6-a62d-5d37-9d2d-d0a0ad71628c with scrape type 2
2026-03-27 12:12:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 3f328af6-a62d-5d37-9d2d-d0a0ad71628c, identifier: SM80467
2026-03-27 12:12:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: b2ae7386-4228-5a9d-81b0-128222f07e91 with identifier: BP47777
2026-03-27 12:12:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: b2ae7386-4228-5a9d-81b0-128222f07e91 with identifier: BP47777
2026-03-27 12:12:34 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: b2ae7386-4228-5a9d-81b0-128222f07e91 with identifier: BP47777 to the API
2026-03-27 12:12:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 12:12:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 12:12:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 125,
 'expiration_date': '2026-03-27T16:00:38Z',
 'fuel_type': 'petrol',
 'id': 'b2ae7386-4228-5a9d-81b0-128222f07e91',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BP47777',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Focus',
 'odometer': 101194,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-09-17',
 'seller_name': None,
 'title': 'Ford Focus 1.0 EcoBoost Titanium',
 'transmission': 'manual',
 'trim': 'Titanium',
 'year': 2015}
2026-03-27 12:12:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:12:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BP47777%27 HTTP/1.1" 200 None
2026-03-27 12:12:35 [auto1.nl] INFO: Saving data for BP47777: {'auction_closing_time': 1774627238.0, 'created_time': 1774527052.161339, 'last_price_update_time': 1774613555.119537}
2026-03-27 12:12:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:12:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='BP47777') HTTP/1.1" 204 0
2026-03-27 12:12:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 3f328af6-a62d-5d37-9d2d-d0a0ad71628c with identifier: SM80467
2026-03-27 12:12:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 3f328af6-a62d-5d37-9d2d-d0a0ad71628c with identifier: SM80467
2026-03-27 12:12:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 3f328af6-a62d-5d37-9d2d-d0a0ad71628c with identifier: SM80467 to the API
2026-03-27 12:12:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 12:12:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 12:12:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-27T16:46:37Z',
 'fuel_type': 'diesel',
 'id': '3f328af6-a62d-5d37-9d2d-d0a0ad71628c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/SM80467',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'Sprinter',
 'odometer': 144623,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-03-31',
 'seller_name': None,
 'title': 'Mercedes-Benz Sprinter 213 CDI',
 'transmission': 'manual',
 'trim': '',
 'year': 2015}
2026-03-27 12:12:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:12:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27SM80467%27 HTTP/1.1" 200 None
2026-03-27 12:12:35 [auto1.nl] INFO: Saving data for SM80467: {'auction_closing_time': 1774629997.0, 'created_time': 1774527068.884699, 'last_price_update_time': 1774613555.527603}
2026-03-27 12:12:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:12:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='SM80467') HTTP/1.1" 204 0
2026-03-27 12:12:35 [auto1.nl] INFO: Found listing with ID: DW43709
2026-03-27 12:12:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:12:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DW43709%27 HTTP/1.1" 200 None
2026-03-27 12:12:35 [auto1.nl] INFO: Scrape type for DW43709: 2
2026-03-27 12:12:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 366e2ea1-0eee-5832-a306-aeed007a1b55 with identifier: DW43709
2026-03-27 12:12:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 366e2ea1-0eee-5832-a306-aeed007a1b55 with scrape type 2
2026-03-27 12:12:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 366e2ea1-0eee-5832-a306-aeed007a1b55 with scrape type 2
2026-03-27 12:12:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 366e2ea1-0eee-5832-a306-aeed007a1b55, identifier: DW43709
2026-03-27 12:12:35 [auto1.nl] INFO: Found listing with ID: AJ38016
2026-03-27 12:12:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:12:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AJ38016%27 HTTP/1.1" 200 None
2026-03-27 12:12:35 [auto1.nl] INFO: Scrape type for AJ38016: 0
2026-03-27 12:12:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 366e2ea1-0eee-5832-a306-aeed007a1b55 with identifier: DW43709
2026-03-27 12:12:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 366e2ea1-0eee-5832-a306-aeed007a1b55 with identifier: DW43709
2026-03-27 12:12:35 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 366e2ea1-0eee-5832-a306-aeed007a1b55 with identifier: DW43709 to the API
2026-03-27 12:12:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 12:12:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 12:12:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 90,
 'expiration_date': '2026-03-27T16:44:05Z',
 'fuel_type': 'petrol',
 'id': '366e2ea1-0eee-5832-a306-aeed007a1b55',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/DW43709',
 'listing': 'auction',
 'make': 'Opel',
 'model': 'Corsa',
 'odometer': 80671,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2017-03-05',
 'seller_name': None,
 'title': 'Opel Corsa 1.4 Color Edition',
 'transmission': 'manual',
 'trim': 'Color Edition',
 'year': 2017}
2026-03-27 12:12:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:12:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27DW43709%27 HTTP/1.1" 200 None
2026-03-27 12:12:35 [auto1.nl] INFO: Saving data for DW43709: {'auction_closing_time': 1774629845.0, 'created_time': 1774527075.124354, 'last_price_update_time': 1774613555.950862}
2026-03-27 12:12:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:12:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='DW43709') HTTP/1.1" 204 0
2026-03-27 12:12:35 [auto1.nl] INFO: Found listing with ID: WS89953
2026-03-27 12:12:35 [auto1.nl] INFO: Found listing with ID: TE69449
2026-03-27 12:12:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:12:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TE69449%27 HTTP/1.1" 200 None
2026-03-27 12:12:35 [auto1.nl] INFO: Scrape type for TE69449: 2
2026-03-27 12:12:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 10b100ab-d438-59e8-b3c8-c2eac539c5b0 with identifier: TE69449
2026-03-27 12:12:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 10b100ab-d438-59e8-b3c8-c2eac539c5b0 with scrape type 2
2026-03-27 12:12:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 10b100ab-d438-59e8-b3c8-c2eac539c5b0 with scrape type 2
2026-03-27 12:12:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 10b100ab-d438-59e8-b3c8-c2eac539c5b0, identifier: TE69449
2026-03-27 12:12:36 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 12:12:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 10b100ab-d438-59e8-b3c8-c2eac539c5b0 with identifier: TE69449
2026-03-27 12:12:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 10b100ab-d438-59e8-b3c8-c2eac539c5b0 with identifier: TE69449
2026-03-27 12:12:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 10b100ab-d438-59e8-b3c8-c2eac539c5b0 with identifier: TE69449 to the API
2026-03-27 12:12:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 12:12:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 12:12:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 85,
 'expiration_date': '2026-03-27T16:23:59Z',
 'fuel_type': 'petrol',
 'id': '10b100ab-d438-59e8-b3c8-c2eac539c5b0',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TE69449',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Fiesta',
 'odometer': 79720,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-10-14',
 'seller_name': None,
 'title': 'Ford Fiesta 1.1 Cool&Connect',
 'transmission': 'manual',
 'trim': 'Cool&Connect',
 'year': 2019}
2026-03-27 12:12:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:12:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TE69449%27 HTTP/1.1" 200 None
2026-03-27 12:12:36 [auto1.nl] INFO: Saving data for TE69449: {'auction_closing_time': 1774628639.0, 'created_time': 1774095052.733088, 'last_price_update_time': 1774613556.339848}
2026-03-27 12:12:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:12:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='TE69449') HTTP/1.1" 204 0
2026-03-27 12:12:36 [auto1.nl] INFO: Found listing with ID: FH26666
2026-03-27 12:12:36 [auto1.nl] INFO: Found listing with ID: AS78971
2026-03-27 12:12:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:12:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AS78971%27 HTTP/1.1" 200 None
2026-03-27 12:12:36 [auto1.nl] INFO: Scrape type for AS78971: 2
2026-03-27 12:12:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3195d25b-3947-5901-8e14-d7075a6066a2 with identifier: AS78971
2026-03-27 12:12:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3195d25b-3947-5901-8e14-d7075a6066a2 with scrape type 2
2026-03-27 12:12:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3195d25b-3947-5901-8e14-d7075a6066a2 with scrape type 2
2026-03-27 12:12:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 3195d25b-3947-5901-8e14-d7075a6066a2, identifier: AS78971
2026-03-27 12:12:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 3195d25b-3947-5901-8e14-d7075a6066a2 with identifier: AS78971
2026-03-27 12:12:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 3195d25b-3947-5901-8e14-d7075a6066a2 with identifier: AS78971
2026-03-27 12:12:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 3195d25b-3947-5901-8e14-d7075a6066a2 with identifier: AS78971 to the API
2026-03-27 12:12:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 12:12:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 12:12:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-27T16:21:31Z',
 'fuel_type': 'diesel',
 'id': '3195d25b-3947-5901-8e14-d7075a6066a2',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/AS78971',
 'listing': 'auction',
 'make': 'Renault',
 'model': 'Kangoo',
 'odometer': 28500,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2022-12-28',
 'seller_name': None,
 'title': 'Renault Kangoo 1.5 BLUE dCi Advance',
 'transmission': 'manual',
 'trim': 'Advance',
 'year': 2022}
2026-03-27 12:12:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:12:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27AS78971%27 HTTP/1.1" 200 None
2026-03-27 12:12:36 [auto1.nl] INFO: Saving data for AS78971: {'auction_closing_time': 1774628491.0, 'created_time': 1774527047.585347, 'last_price_update_time': 1774613556.719742}
2026-03-27 12:12:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:12:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='AS78971') HTTP/1.1" 204 0
2026-03-27 12:12:36 [auto1.nl] INFO: Found listing with ID: SF92286
2026-03-27 12:12:36 [auto1.nl] INFO: Found listing with ID: EC34005
2026-03-27 12:12:36 [auto1.nl] INFO: Found listing with ID: RD50492
2026-03-27 12:12:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:12:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RD50492%27 HTTP/1.1" 200 None
2026-03-27 12:12:36 [auto1.nl] INFO: Scrape type for RD50492: 2
2026-03-27 12:12:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e156fc90-d653-51d4-b766-d854cca6a626 with identifier: RD50492
2026-03-27 12:12:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e156fc90-d653-51d4-b766-d854cca6a626 with scrape type 2
2026-03-27 12:12:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e156fc90-d653-51d4-b766-d854cca6a626 with scrape type 2
2026-03-27 12:12:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: e156fc90-d653-51d4-b766-d854cca6a626, identifier: RD50492
2026-03-27 12:12:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: e156fc90-d653-51d4-b766-d854cca6a626 with identifier: RD50492
2026-03-27 12:12:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: e156fc90-d653-51d4-b766-d854cca6a626 with identifier: RD50492
2026-03-27 12:12:36 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: e156fc90-d653-51d4-b766-d854cca6a626 with identifier: RD50492 to the API
2026-03-27 12:12:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 12:12:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 12:12:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 130,
 'expiration_date': '2026-03-27T16:18:49Z',
 'fuel_type': 'diesel',
 'id': 'e156fc90-d653-51d4-b766-d854cca6a626',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/RD50492',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Transit',
 'odometer': 416525,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2007-07-19',
 'seller_name': None,
 'title': 'Ford Transit 2.2 TDCi FT 260 K LKW',
 'transmission': 'manual',
 'trim': 'FT 260 K LKW',
 'year': 2007}
2026-03-27 12:12:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:12:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27RD50492%27 HTTP/1.1" 200 None
2026-03-27 12:12:37 [auto1.nl] INFO: Saving data for RD50492: {'auction_closing_time': 1774628329.0, 'created_time': 1774527060.674706, 'last_price_update_time': 1774613557.110014}
2026-03-27 12:12:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:12:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='RD50492') HTTP/1.1" 204 0
2026-03-27 12:12:37 [auto1.nl] INFO: Channel: 24h | Page: 27 | totalHits: 1061 | hits on page: 21
2026-03-27 12:12:37 [auto1.nl] INFO: Found listing with ID: LD78562
2026-03-27 12:12:37 [auto1.nl] INFO: Found listing with ID: JH24547
2026-03-27 12:12:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:12:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JH24547%27 HTTP/1.1" 200 None
2026-03-27 12:12:37 [auto1.nl] INFO: Scrape type for JH24547: 0
2026-03-27 12:12:37 [auto1.nl] INFO: Found listing with ID: DX40194
2026-03-27 12:12:37 [auto1.nl] INFO: Found listing with ID: WC55998
2026-03-27 12:12:37 [auto1.nl] INFO: Found listing with ID: FC55354
2026-03-27 12:12:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:12:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FC55354%27 HTTP/1.1" 200 None
2026-03-27 12:12:37 [auto1.nl] INFO: Scrape type for FC55354: 2
2026-03-27 12:12:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b23168ed-66d2-58db-9ece-2dbc3e9e2e5d with identifier: FC55354
2026-03-27 12:12:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b23168ed-66d2-58db-9ece-2dbc3e9e2e5d with scrape type 2
2026-03-27 12:12:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b23168ed-66d2-58db-9ece-2dbc3e9e2e5d with scrape type 2
2026-03-27 12:12:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: b23168ed-66d2-58db-9ece-2dbc3e9e2e5d, identifier: FC55354
2026-03-27 12:12:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: b23168ed-66d2-58db-9ece-2dbc3e9e2e5d with identifier: FC55354
2026-03-27 12:12:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: b23168ed-66d2-58db-9ece-2dbc3e9e2e5d with identifier: FC55354
2026-03-27 12:12:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: b23168ed-66d2-58db-9ece-2dbc3e9e2e5d with identifier: FC55354 to the API
2026-03-27 12:12:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 12:12:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 12:12:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-27T16:04:58Z',
 'fuel_type': 'diesel',
 'id': 'b23168ed-66d2-58db-9ece-2dbc3e9e2e5d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FC55354',
 'listing': 'auction',
 'make': 'Jaguar',
 'model': 'E-Pace',
 'odometer': 149406,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-02-13',
 'seller_name': None,
 'title': 'Jaguar E-Pace D150 S',
 'transmission': 'manual',
 'trim': 'S',
 'year': 2018}
2026-03-27 12:12:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:12:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FC55354%27 HTTP/1.1" 200 None
2026-03-27 12:12:37 [auto1.nl] INFO: Saving data for FC55354: {'auction_closing_time': 1774627498.0, 'created_time': 1774527064.842093, 'last_price_update_time': 1774613557.520767}
2026-03-27 12:12:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:12:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='FC55354') HTTP/1.1" 204 0
2026-03-27 12:12:37 [auto1.nl] INFO: Found listing with ID: JA24721
2026-03-27 12:12:37 [auto1.nl] INFO: Found listing with ID: GP94169
2026-03-27 12:12:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:12:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GP94169%27 HTTP/1.1" 200 None
2026-03-27 12:12:37 [auto1.nl] INFO: Scrape type for GP94169: 2
2026-03-27 12:12:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2ce4c4d6-ec72-5c9f-b2d2-ddfd17362e7d with identifier: GP94169
2026-03-27 12:12:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2ce4c4d6-ec72-5c9f-b2d2-ddfd17362e7d with scrape type 2
2026-03-27 12:12:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2ce4c4d6-ec72-5c9f-b2d2-ddfd17362e7d with scrape type 2
2026-03-27 12:12:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 2ce4c4d6-ec72-5c9f-b2d2-ddfd17362e7d, identifier: GP94169
2026-03-27 12:12:37 [auto1.nl] INFO: Found listing with ID: JH98357
2026-03-27 12:12:37 [auto1.nl] INFO: Found listing with ID: SY88026
2026-03-27 12:12:37 [auto1.nl] INFO: Found listing with ID: TU57635
2026-03-27 12:12:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:12:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TU57635%27 HTTP/1.1" 200 None
2026-03-27 12:12:37 [auto1.nl] INFO: Scrape type for TU57635: 2
2026-03-27 12:12:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6df5f0fb-4821-5c39-b3f7-243f340d6789 with identifier: TU57635
2026-03-27 12:12:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6df5f0fb-4821-5c39-b3f7-243f340d6789 with scrape type 2
2026-03-27 12:12:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6df5f0fb-4821-5c39-b3f7-243f340d6789 with scrape type 2
2026-03-27 12:12:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 6df5f0fb-4821-5c39-b3f7-243f340d6789, identifier: TU57635
2026-03-27 12:12:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 2ce4c4d6-ec72-5c9f-b2d2-ddfd17362e7d with identifier: GP94169
2026-03-27 12:12:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 2ce4c4d6-ec72-5c9f-b2d2-ddfd17362e7d with identifier: GP94169
2026-03-27 12:12:37 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 2ce4c4d6-ec72-5c9f-b2d2-ddfd17362e7d with identifier: GP94169 to the API
2026-03-27 12:12:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 12:12:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 12:12:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 85,
 'expiration_date': '2026-03-27T16:40:44Z',
 'fuel_type': 'petrol',
 'id': '2ce4c4d6-ec72-5c9f-b2d2-ddfd17362e7d',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GP94169',
 'listing': 'auction',
 'make': 'Fiat',
 'model': 'Panda',
 'odometer': 121436,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2012-04-26',
 'seller_name': None,
 'title': 'Fiat Panda 0.9 Lounge',
 'transmission': 'manual',
 'trim': 'Lounge',
 'year': 2012}
2026-03-27 12:12:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:12:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GP94169%27 HTTP/1.1" 200 None
2026-03-27 12:12:38 [auto1.nl] INFO: Saving data for GP94169: {'auction_closing_time': 1774629644.0, 'created_time': 1773817852.552338, 'last_price_update_time': 1774613558.125423}
2026-03-27 12:12:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:12:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='GP94169') HTTP/1.1" 204 0
2026-03-27 12:12:38 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-27 12:12:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 6df5f0fb-4821-5c39-b3f7-243f340d6789 with identifier: TU57635
2026-03-27 12:12:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 6df5f0fb-4821-5c39-b3f7-243f340d6789 with identifier: TU57635
2026-03-27 12:12:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 6df5f0fb-4821-5c39-b3f7-243f340d6789 with identifier: TU57635 to the API
2026-03-27 12:12:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 12:12:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 12:12:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 205,
 'expiration_date': '2026-03-27T16:09:14Z',
 'fuel_type': 'petrol',
 'id': '6df5f0fb-4821-5c39-b3f7-243f340d6789',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/TU57635',
 'listing': 'auction',
 'make': 'BMW',
 'model': '5er',
 'odometer': 276474,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2011-08-14',
 'seller_name': None,
 'title': 'BMW 5er 523i',
 'transmission': 'automatic',
 'trim': '',
 'year': 2011}
2026-03-27 12:12:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:12:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27TU57635%27 HTTP/1.1" 200 None
2026-03-27 12:12:38 [auto1.nl] INFO: Saving data for TU57635: {'auction_closing_time': 1774627754.0, 'created_time': 1773232418.772815, 'last_price_update_time': 1774613558.421274}
2026-03-27 12:12:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:12:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='TU57635') HTTP/1.1" 204 0
2026-03-27 12:12:38 [auto1.nl] INFO: Found listing with ID: RX96199
2026-03-27 12:12:38 [auto1.nl] INFO: Found listing with ID: TN49193
2026-03-27 12:12:38 [auto1.nl] INFO: Found listing with ID: WR79727
2026-03-27 12:12:38 [auto1.nl] INFO: Found listing with ID: BX68417
2026-03-27 12:12:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:12:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BX68417%27 HTTP/1.1" 200 None
2026-03-27 12:12:38 [auto1.nl] INFO: Scrape type for BX68417: 2
2026-03-27 12:12:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e67252f4-3c2e-5c24-9311-9e28f9964461 with identifier: BX68417
2026-03-27 12:12:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e67252f4-3c2e-5c24-9311-9e28f9964461 with scrape type 2
2026-03-27 12:12:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e67252f4-3c2e-5c24-9311-9e28f9964461 with scrape type 2
2026-03-27 12:12:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: e67252f4-3c2e-5c24-9311-9e28f9964461, identifier: BX68417
2026-03-27 12:12:38 [auto1.nl] INFO: Found listing with ID: FU47491
2026-03-27 12:12:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:12:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FU47491%27 HTTP/1.1" 200 None
2026-03-27 12:12:38 [auto1.nl] INFO: Scrape type for FU47491: 2
2026-03-27 12:12:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f247b869-698f-59d3-bc8c-18e9c26a6e85 with identifier: FU47491
2026-03-27 12:12:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f247b869-698f-59d3-bc8c-18e9c26a6e85 with scrape type 2
2026-03-27 12:12:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f247b869-698f-59d3-bc8c-18e9c26a6e85 with scrape type 2
2026-03-27 12:12:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: f247b869-698f-59d3-bc8c-18e9c26a6e85, identifier: FU47491
2026-03-27 12:12:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: e67252f4-3c2e-5c24-9311-9e28f9964461 with identifier: BX68417
2026-03-27 12:12:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: e67252f4-3c2e-5c24-9311-9e28f9964461 with identifier: BX68417
2026-03-27 12:12:38 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: e67252f4-3c2e-5c24-9311-9e28f9964461 with identifier: BX68417 to the API
2026-03-27 12:12:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 12:12:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 12:12:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-27T16:18:01Z',
 'fuel_type': 'petrol',
 'id': 'e67252f4-3c2e-5c24-9311-9e28f9964461',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/BX68417',
 'listing': 'auction',
 'make': 'MINI',
 'model': 'Countryman',
 'odometer': 193426,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-01-02',
 'seller_name': None,
 'title': 'MINI Countryman Cooper',
 'transmission': 'manual',
 'trim': '',
 'year': 2014}
2026-03-27 12:12:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:12:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27BX68417%27 HTTP/1.1" 200 None
2026-03-27 12:12:38 [auto1.nl] INFO: Saving data for BX68417: {'auction_closing_time': 1774628281.0, 'created_time': 1774527058.137435, 'last_price_update_time': 1774613558.973449}
2026-03-27 12:12:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:12:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='BX68417') HTTP/1.1" 204 0
2026-03-27 12:12:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: f247b869-698f-59d3-bc8c-18e9c26a6e85 with identifier: FU47491
2026-03-27 12:12:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: f247b869-698f-59d3-bc8c-18e9c26a6e85 with identifier: FU47491
2026-03-27 12:12:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: f247b869-698f-59d3-bc8c-18e9c26a6e85 with identifier: FU47491 to the API
2026-03-27 12:12:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 12:12:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 12:12:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 110,
 'expiration_date': '2026-03-27T16:55:11Z',
 'fuel_type': 'petrol',
 'id': 'f247b869-698f-59d3-bc8c-18e9c26a6e85',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FU47491',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': '308',
 'odometer': 129963,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2015-10-26',
 'seller_name': None,
 'title': 'Peugeot 308 1.2 e-THP Style',
 'transmission': 'manual',
 'trim': 'Style',
 'year': 2015}
2026-03-27 12:12:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:12:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FU47491%27 HTTP/1.1" 200 None
2026-03-27 12:12:39 [auto1.nl] INFO: Saving data for FU47491: {'auction_closing_time': 1774630511.0, 'created_time': 1774527084.979726, 'last_price_update_time': 1774613559.254153}
2026-03-27 12:12:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:12:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='FU47491') HTTP/1.1" 204 0
2026-03-27 12:12:39 [auto1.nl] INFO: Found listing with ID: UC91516
2026-03-27 12:12:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:12:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UC91516%27 HTTP/1.1" 200 None
2026-03-27 12:12:39 [auto1.nl] INFO: Scrape type for UC91516: 2
2026-03-27 12:12:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 28a48e36-0870-5f29-851c-0c597c61f9d7 with identifier: UC91516
2026-03-27 12:12:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 28a48e36-0870-5f29-851c-0c597c61f9d7 with scrape type 2
2026-03-27 12:12:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 28a48e36-0870-5f29-851c-0c597c61f9d7 with scrape type 2
2026-03-27 12:12:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 28a48e36-0870-5f29-851c-0c597c61f9d7, identifier: UC91516
2026-03-27 12:12:39 [auto1.nl] INFO: Found listing with ID: WK39469
2026-03-27 12:12:39 [auto1.nl] INFO: Found listing with ID: XY38299
2026-03-27 12:12:39 [auto1.nl] INFO: Found listing with ID: JR94083
2026-03-27 12:12:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:12:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JR94083%27 HTTP/1.1" 200 None
2026-03-27 12:12:39 [auto1.nl] INFO: Scrape type for JR94083: 2
2026-03-27 12:12:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9ff40f21-3970-51e5-9a0e-eb9d3b70a3f1 with identifier: JR94083
2026-03-27 12:12:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9ff40f21-3970-51e5-9a0e-eb9d3b70a3f1 with scrape type 2
2026-03-27 12:12:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9ff40f21-3970-51e5-9a0e-eb9d3b70a3f1 with scrape type 2
2026-03-27 12:12:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 9ff40f21-3970-51e5-9a0e-eb9d3b70a3f1, identifier: JR94083
2026-03-27 12:12:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 28a48e36-0870-5f29-851c-0c597c61f9d7 with identifier: UC91516
2026-03-27 12:12:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 28a48e36-0870-5f29-851c-0c597c61f9d7 with identifier: UC91516
2026-03-27 12:12:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 28a48e36-0870-5f29-851c-0c597c61f9d7 with identifier: UC91516 to the API
2026-03-27 12:12:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 12:12:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 12:12:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 455,
 'expiration_date': '2026-03-27T16:59:29Z',
 'fuel_type': 'petrol',
 'id': '28a48e36-0870-5f29-851c-0c597c61f9d7',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/UC91516',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'S-Klasse',
 'odometer': 241806,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2014-06-24',
 'seller_name': None,
 'title': 'Mercedes-Benz S-Klasse S 500',
 'transmission': 'automatic',
 'trim': '',
 'year': 2014}
2026-03-27 12:12:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:12:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27UC91516%27 HTTP/1.1" 200 None
2026-03-27 12:12:39 [auto1.nl] INFO: Saving data for UC91516: {'auction_closing_time': 1774630769.0, 'created_time': 1773861312.446374, 'last_price_update_time': 1774613559.732387}
2026-03-27 12:12:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:12:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='UC91516') HTTP/1.1" 204 0
2026-03-27 12:12:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 9ff40f21-3970-51e5-9a0e-eb9d3b70a3f1 with identifier: JR94083
2026-03-27 12:12:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 9ff40f21-3970-51e5-9a0e-eb9d3b70a3f1 with identifier: JR94083
2026-03-27 12:12:39 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 9ff40f21-3970-51e5-9a0e-eb9d3b70a3f1 with identifier: JR94083 to the API
2026-03-27 12:12:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 12:12:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 12:12:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-27T16:28:45Z',
 'fuel_type': 'petrol',
 'id': '9ff40f21-3970-51e5-9a0e-eb9d3b70a3f1',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/JR94083',
 'listing': 'auction',
 'make': 'Mercedes-Benz',
 'model': 'CLA-Klasse',
 'odometer': 102400,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-12-22',
 'seller_name': None,
 'title': 'Mercedes-Benz CLA-Klasse CLA 180 AMG Line',
 'transmission': 'manual',
 'trim': 'AMG Line',
 'year': 2016}
2026-03-27 12:12:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:12:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27JR94083%27 HTTP/1.1" 200 None
2026-03-27 12:12:40 [auto1.nl] INFO: Saving data for JR94083: {'auction_closing_time': 1774628925.0, 'created_time': 1774034002.391757, 'last_price_update_time': 1774613560.115737}
2026-03-27 12:12:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:12:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='JR94083') HTTP/1.1" 204 0
2026-03-27 12:12:40 [auto1.nl] INFO: Found listing with ID: KJ96677
2026-03-27 12:12:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:12:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KJ96677%27 HTTP/1.1" 200 None
2026-03-27 12:12:40 [auto1.nl] INFO: Scrape type for KJ96677: 2
2026-03-27 12:12:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9bda7d1b-7e88-5b9a-949d-2c49ed2d55a3 with identifier: KJ96677
2026-03-27 12:12:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9bda7d1b-7e88-5b9a-949d-2c49ed2d55a3 with scrape type 2
2026-03-27 12:12:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9bda7d1b-7e88-5b9a-949d-2c49ed2d55a3 with scrape type 2
2026-03-27 12:12:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 9bda7d1b-7e88-5b9a-949d-2c49ed2d55a3, identifier: KJ96677
2026-03-27 12:12:40 [auto1.nl] INFO: Found listing with ID: VT81070
2026-03-27 12:12:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:12:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VT81070%27 HTTP/1.1" 200 None
2026-03-27 12:12:40 [auto1.nl] INFO: Scrape type for VT81070: 2
2026-03-27 12:12:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c1b6fa53-1974-57fe-8126-e82a2a9066e8 with identifier: VT81070
2026-03-27 12:12:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c1b6fa53-1974-57fe-8126-e82a2a9066e8 with scrape type 2
2026-03-27 12:12:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c1b6fa53-1974-57fe-8126-e82a2a9066e8 with scrape type 2
2026-03-27 12:12:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: c1b6fa53-1974-57fe-8126-e82a2a9066e8, identifier: VT81070
2026-03-27 12:12:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 9bda7d1b-7e88-5b9a-949d-2c49ed2d55a3 with identifier: KJ96677
2026-03-27 12:12:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 9bda7d1b-7e88-5b9a-949d-2c49ed2d55a3 with identifier: KJ96677
2026-03-27 12:12:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 9bda7d1b-7e88-5b9a-949d-2c49ed2d55a3 with identifier: KJ96677 to the API
2026-03-27 12:12:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 12:12:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 12:12:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 150,
 'expiration_date': '2026-03-27T16:05:30Z',
 'fuel_type': 'petrol',
 'id': '9bda7d1b-7e88-5b9a-949d-2c49ed2d55a3',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/KJ96677',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Golf VII',
 'odometer': 108301,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2019-06-30',
 'seller_name': None,
 'title': 'Volkswagen Golf VII 1.5 TSI ACT Highline BlueMotion',
 'transmission': 'manual',
 'trim': 'Highline BlueMotion',
 'year': 2019}
2026-03-27 12:12:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:12:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KJ96677%27 HTTP/1.1" 200 None
2026-03-27 12:12:40 [auto1.nl] INFO: Saving data for KJ96677: {'auction_closing_time': 1774627530.0, 'created_time': 1774527066.029128, 'last_price_update_time': 1774613560.659923}
2026-03-27 12:12:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:12:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='KJ96677') HTTP/1.1" 204 0
2026-03-27 12:12:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: c1b6fa53-1974-57fe-8126-e82a2a9066e8 with identifier: VT81070
2026-03-27 12:12:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: c1b6fa53-1974-57fe-8126-e82a2a9066e8 with identifier: VT81070
2026-03-27 12:12:40 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: c1b6fa53-1974-57fe-8126-e82a2a9066e8 with identifier: VT81070 to the API
2026-03-27 12:12:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 12:12:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 12:12:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 132,
 'expiration_date': '2026-03-27T16:21:35Z',
 'fuel_type': 'petrol',
 'id': 'c1b6fa53-1974-57fe-8126-e82a2a9066e8',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VT81070',
 'listing': 'auction',
 'make': 'Kia',
 'model': 'Sportage',
 'odometer': 188733,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2016-01-07',
 'seller_name': None,
 'title': 'Kia Sportage 1.6 GDI Attract 2WD',
 'transmission': 'manual',
 'trim': 'Attract 2WD',
 'year': 2016}
2026-03-27 12:12:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:12:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VT81070%27 HTTP/1.1" 200 None
2026-03-27 12:12:40 [auto1.nl] INFO: Saving data for VT81070: {'auction_closing_time': 1774628495.0, 'created_time': 1774527057.252096, 'last_price_update_time': 1774613560.935178}
2026-03-27 12:12:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:12:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='VT81070') HTTP/1.1" 204 0
2026-03-27 12:12:40 [auto1.nl] INFO: Found listing with ID: AX29422
2026-03-27 12:12:40 [auto1.nl] INFO: Found listing with ID: DF87411
2026-03-27 12:12:40 [auto1.nl] INFO: Found listing with ID: UA44354
2026-03-27 12:12:40 [auto1.nl] INFO: Found listing with ID: JJ61661
2026-03-27 12:12:40 [auto1.nl] INFO: Found listing with ID: KP98004
2026-03-27 12:12:40 [auto1.nl] INFO: Found listing with ID: FJ00169
2026-03-27 12:12:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:12:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FJ00169%27 HTTP/1.1" 200 None
2026-03-27 12:12:40 [auto1.nl] INFO: Scrape type for FJ00169: 2
2026-03-27 12:12:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d6fdcb6b-feb2-5129-9cd6-89a41582fd14 with identifier: FJ00169
2026-03-27 12:12:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d6fdcb6b-feb2-5129-9cd6-89a41582fd14 with scrape type 2
2026-03-27 12:12:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d6fdcb6b-feb2-5129-9cd6-89a41582fd14 with scrape type 2
2026-03-27 12:12:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: d6fdcb6b-feb2-5129-9cd6-89a41582fd14, identifier: FJ00169
2026-03-27 12:12:41 [auto1.nl] INFO: Found listing with ID: VV45583
2026-03-27 12:12:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:12:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VV45583%27 HTTP/1.1" 200 None
2026-03-27 12:12:41 [auto1.nl] INFO: Scrape type for VV45583: 2
2026-03-27 12:12:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4d4076c7-1136-5c41-a3cd-0c8826012f8a with identifier: VV45583
2026-03-27 12:12:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4d4076c7-1136-5c41-a3cd-0c8826012f8a with scrape type 2
2026-03-27 12:12:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4d4076c7-1136-5c41-a3cd-0c8826012f8a with scrape type 2
2026-03-27 12:12:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 4d4076c7-1136-5c41-a3cd-0c8826012f8a, identifier: VV45583
2026-03-27 12:12:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: d6fdcb6b-feb2-5129-9cd6-89a41582fd14 with identifier: FJ00169
2026-03-27 12:12:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: d6fdcb6b-feb2-5129-9cd6-89a41582fd14 with identifier: FJ00169
2026-03-27 12:12:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: d6fdcb6b-feb2-5129-9cd6-89a41582fd14 with identifier: FJ00169 to the API
2026-03-27 12:12:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 12:12:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 12:12:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-27T16:58:00Z',
 'fuel_type': 'diesel',
 'id': 'd6fdcb6b-feb2-5129-9cd6-89a41582fd14',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/FJ00169',
 'listing': 'auction',
 'make': 'Peugeot',
 'model': 'Partner',
 'odometer': 170008,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-02-13',
 'seller_name': None,
 'title': 'Peugeot Partner 1.5 Blue-HDi Premium L1',
 'transmission': 'manual',
 'trim': 'Premium L1',
 'year': 2020}
2026-03-27 12:12:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:12:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27FJ00169%27 HTTP/1.1" 200 None
2026-03-27 12:12:41 [auto1.nl] INFO: Saving data for FJ00169: {'auction_closing_time': 1774630680.0, 'created_time': 1774527062.760754, 'last_price_update_time': 1774613561.418663}
2026-03-27 12:12:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:12:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='FJ00169') HTTP/1.1" 204 0
2026-03-27 12:12:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 4d4076c7-1136-5c41-a3cd-0c8826012f8a with identifier: VV45583
2026-03-27 12:12:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 4d4076c7-1136-5c41-a3cd-0c8826012f8a with identifier: VV45583
2026-03-27 12:12:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 4d4076c7-1136-5c41-a3cd-0c8826012f8a with identifier: VV45583 to the API
2026-03-27 12:12:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 12:12:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 12:12:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'gray',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 75,
 'expiration_date': '2026-03-27T16:41:35Z',
 'fuel_type': 'diesel',
 'id': '4d4076c7-1136-5c41-a3cd-0c8826012f8a',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/VV45583',
 'listing': 'auction',
 'make': 'Seat',
 'model': 'Ibiza',
 'odometer': 252925,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2010-11-12',
 'seller_name': None,
 'title': 'Seat Ibiza 1.2 TDI Style',
 'transmission': 'manual',
 'trim': 'Style',
 'year': 2010}
2026-03-27 12:12:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:12:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27VV45583%27 HTTP/1.1" 200 None
2026-03-27 12:12:41 [auto1.nl] INFO: Saving data for VV45583: {'auction_closing_time': 1774629695.0, 'created_time': 1774527056.88251, 'last_price_update_time': 1774613561.709388}
2026-03-27 12:12:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:12:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='VV45583') HTTP/1.1" 204 0
2026-03-27 12:12:41 [auto1.nl] INFO: Found listing with ID: PZ30163
2026-03-27 12:12:41 [auto1.nl] INFO: Found listing with ID: RL18676
2026-03-27 12:12:41 [auto1.nl] INFO: Found listing with ID: RF14080
2026-03-27 12:12:41 [auto1.nl] INFO: Found listing with ID: WN67246
2026-03-27 12:12:41 [auto1.nl] INFO: Found listing with ID: TY96036
2026-03-27 12:12:41 [auto1.nl] INFO: Found listing with ID: MY95801
2026-03-27 12:12:41 [auto1.nl] INFO: Found listing with ID: KX43550
2026-03-27 12:12:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:12:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27KX43550%27 HTTP/1.1" 200 None
2026-03-27 12:12:41 [auto1.nl] INFO: Scrape type for KX43550: 0
2026-03-27 12:12:41 [auto1.nl] INFO: Found listing with ID: JK19053
2026-03-27 12:12:41 [auto1.nl] INFO: Found listing with ID: MJ47722
2026-03-27 12:12:41 [auto1.nl] INFO: Found listing with ID: RT82599
2026-03-27 12:12:41 [auto1.nl] INFO: Found listing with ID: RY51498
2026-03-27 12:12:41 [auto1.nl] INFO: Found listing with ID: YG43162
2026-03-27 12:12:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:12:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YG43162%27 HTTP/1.1" 200 None
2026-03-27 12:12:41 [auto1.nl] INFO: Scrape type for YG43162: 2
2026-03-27 12:12:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3ab58fb3-73bd-5c2d-a006-c72475a8e940 with identifier: YG43162
2026-03-27 12:12:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3ab58fb3-73bd-5c2d-a006-c72475a8e940 with scrape type 2
2026-03-27 12:12:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3ab58fb3-73bd-5c2d-a006-c72475a8e940 with scrape type 2
2026-03-27 12:12:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 3ab58fb3-73bd-5c2d-a006-c72475a8e940, identifier: YG43162
2026-03-27 12:12:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 3ab58fb3-73bd-5c2d-a006-c72475a8e940 with identifier: YG43162
2026-03-27 12:12:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 3ab58fb3-73bd-5c2d-a006-c72475a8e940 with identifier: YG43162
2026-03-27 12:12:41 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 3ab58fb3-73bd-5c2d-a006-c72475a8e940 with identifier: YG43162 to the API
2026-03-27 12:12:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 12:12:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 12:12:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 4,
 'engine_horse_power': 131,
 'expiration_date': '2026-03-27T16:32:34Z',
 'fuel_type': 'diesel',
 'id': '3ab58fb3-73bd-5c2d-a006-c72475a8e940',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/YG43162',
 'listing': 'auction',
 'make': 'Ford',
 'model': 'Transit',
 'odometer': 165229,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2021-02-28',
 'seller_name': None,
 'title': 'Ford Transit 2.0 TDCi 310 L2 Trend',
 'transmission': 'manual',
 'trim': '310 L2 Trend',
 'year': 2021}
2026-03-27 12:12:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:12:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27YG43162%27 HTTP/1.1" 200 None
2026-03-27 12:12:42 [auto1.nl] INFO: Saving data for YG43162: {'auction_closing_time': 1774629154.0, 'created_time': 1774527074.525638, 'last_price_update_time': 1774613562.113505}
2026-03-27 12:12:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:12:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='YG43162') HTTP/1.1" 204 0
2026-03-27 12:12:42 [auto1.nl] INFO: Found listing with ID: PL46145
2026-03-27 12:12:42 [auto1.nl] INFO: Found listing with ID: MU55364
2026-03-27 12:12:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:12:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MU55364%27 HTTP/1.1" 200 None
2026-03-27 12:12:42 [auto1.nl] INFO: Scrape type for MU55364: 2
2026-03-27 12:12:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: caf8d68b-1aea-5519-9aa0-31971e8f760f with identifier: MU55364
2026-03-27 12:12:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item caf8d68b-1aea-5519-9aa0-31971e8f760f with scrape type 2
2026-03-27 12:12:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item caf8d68b-1aea-5519-9aa0-31971e8f760f with scrape type 2
2026-03-27 12:12:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: caf8d68b-1aea-5519-9aa0-31971e8f760f, identifier: MU55364
2026-03-27 12:12:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: caf8d68b-1aea-5519-9aa0-31971e8f760f with identifier: MU55364
2026-03-27 12:12:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: caf8d68b-1aea-5519-9aa0-31971e8f760f with identifier: MU55364
2026-03-27 12:12:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: caf8d68b-1aea-5519-9aa0-31971e8f760f with identifier: MU55364 to the API
2026-03-27 12:12:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 12:12:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 12:12:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'blue',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 122,
 'expiration_date': '2026-03-27T16:43:48Z',
 'fuel_type': 'hybrid',
 'id': 'caf8d68b-1aea-5519-9aa0-31971e8f760f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/MU55364',
 'listing': 'auction',
 'make': 'Toyota',
 'model': 'Corolla',
 'odometer': 161454,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-09-11',
 'seller_name': None,
 'title': 'Toyota Corolla 1.8 Hybrid Comfort',
 'transmission': 'automatic',
 'trim': 'Comfort',
 'year': 2020}
2026-03-27 12:12:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:12:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27MU55364%27 HTTP/1.1" 200 None
2026-03-27 12:12:42 [auto1.nl] INFO: Saving data for MU55364: {'auction_closing_time': 1774629828.0, 'created_time': 1774527051.006941, 'last_price_update_time': 1774613562.593645}
2026-03-27 12:12:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:12:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='MU55364') HTTP/1.1" 204 0
2026-03-27 12:12:42 [auto1.nl] INFO: Found listing with ID: EK15803
2026-03-27 12:12:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:12:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EK15803%27 HTTP/1.1" 200 None
2026-03-27 12:12:42 [auto1.nl] INFO: Scrape type for EK15803: 2
2026-03-27 12:12:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 486e1b4c-d94f-5533-9830-d86b563230af with identifier: EK15803
2026-03-27 12:12:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 486e1b4c-d94f-5533-9830-d86b563230af with scrape type 2
2026-03-27 12:12:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 486e1b4c-d94f-5533-9830-d86b563230af with scrape type 2
2026-03-27 12:12:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 486e1b4c-d94f-5533-9830-d86b563230af, identifier: EK15803
2026-03-27 12:12:42 [scrapy.core.engine] DEBUG: Crawled (200) <POST https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07> (referer: https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07) ['zyte-api']
2026-03-27 12:12:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 486e1b4c-d94f-5533-9830-d86b563230af with identifier: EK15803
2026-03-27 12:12:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 486e1b4c-d94f-5533-9830-d86b563230af with identifier: EK15803
2026-03-27 12:12:42 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 486e1b4c-d94f-5533-9830-d86b563230af with identifier: EK15803 to the API
2026-03-27 12:12:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 12:12:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 12:12:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'black',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 170,
 'expiration_date': '2026-03-27T16:01:03Z',
 'fuel_type': 'diesel',
 'id': '486e1b4c-d94f-5533-9830-d86b563230af',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/EK15803',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'Touran',
 'odometer': 350701,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2006-05-19',
 'seller_name': None,
 'title': 'Volkswagen Touran 2.0 TDI Highline',
 'transmission': 'automatic',
 'trim': 'Highline',
 'year': 2006}
2026-03-27 12:12:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:12:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27EK15803%27 HTTP/1.1" 200 None
2026-03-27 12:12:42 [auto1.nl] INFO: Saving data for EK15803: {'auction_closing_time': 1774627263.0, 'created_time': 1774527049.744405, 'last_price_update_time': 1774613562.992865}
2026-03-27 12:12:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='EK15803') HTTP/1.1" 204 0
2026-03-27 12:12:43 [auto1.nl] INFO: Found listing with ID: HS95558
2026-03-27 12:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HS95558%27 HTTP/1.1" 200 None
2026-03-27 12:12:43 [auto1.nl] INFO: Scrape type for HS95558: 2
2026-03-27 12:12:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 284b11c4-dfe2-52df-ac24-4abdf3b0082f with identifier: HS95558
2026-03-27 12:12:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 284b11c4-dfe2-52df-ac24-4abdf3b0082f with scrape type 2
2026-03-27 12:12:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 284b11c4-dfe2-52df-ac24-4abdf3b0082f with scrape type 2
2026-03-27 12:12:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 284b11c4-dfe2-52df-ac24-4abdf3b0082f, identifier: HS95558
2026-03-27 12:12:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 284b11c4-dfe2-52df-ac24-4abdf3b0082f with identifier: HS95558
2026-03-27 12:12:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 284b11c4-dfe2-52df-ac24-4abdf3b0082f with identifier: HS95558
2026-03-27 12:12:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 284b11c4-dfe2-52df-ac24-4abdf3b0082f with identifier: HS95558 to the API
2026-03-27 12:12:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 12:12:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 12:12:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'white',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 204,
 'expiration_date': '2026-03-27T16:12:26Z',
 'fuel_type': 'electro',
 'id': '284b11c4-dfe2-52df-ac24-4abdf3b0082f',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': True,
 'is_vat_included': True,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/HS95558',
 'listing': 'auction',
 'make': 'Volkswagen',
 'model': 'ID.4',
 'odometer': 111393,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2020-12-28',
 'seller_name': None,
 'title': 'Volkswagen ID.4 electric drive 150 kW 1st Max Pro Performance',
 'transmission': 'automatic',
 'trim': '1st Max Pro Performance',
 'year': 2020}
2026-03-27 12:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27HS95558%27 HTTP/1.1" 200 None
2026-03-27 12:12:43 [auto1.nl] INFO: Saving data for HS95558: {'auction_closing_time': 1774627946.0, 'created_time': 1774527059.159611, 'last_price_update_time': 1774613563.39347}
2026-03-27 12:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='HS95558') HTTP/1.1" 204 0
2026-03-27 12:12:43 [auto1.nl] INFO: Found listing with ID: GY66252
2026-03-27 12:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GY66252%27 HTTP/1.1" 200 None
2026-03-27 12:12:43 [auto1.nl] INFO: Scrape type for GY66252: 2
2026-03-27 12:12:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 829152da-c1d4-5d48-9b78-fee07b330c0c with identifier: GY66252
2026-03-27 12:12:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 829152da-c1d4-5d48-9b78-fee07b330c0c with scrape type 2
2026-03-27 12:12:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 829152da-c1d4-5d48-9b78-fee07b330c0c with scrape type 2
2026-03-27 12:12:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: auto1.nl, Processed item id: 829152da-c1d4-5d48-9b78-fee07b330c0c, identifier: GY66252
2026-03-27 12:12:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: auto1.nl, Translating item: 829152da-c1d4-5d48-9b78-fee07b330c0c with identifier: GY66252
2026-03-27 12:12:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: auto1.nl, Applying rules to item: 829152da-c1d4-5d48-9b78-fee07b330c0c with identifier: GY66252
2026-03-27 12:12:43 [crawlers.pipelines.post_to_api] INFO: Spider: auto1.nl, Posting item: 829152da-c1d4-5d48-9b78-fee07b330c0c with identifier: GY66252 to the API
2026-03-27 12:12:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-27 12:12:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-27 12:12:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.auto1.com/v1/car-search/cars/search/cdb8adcc-312b-4040-b112-4a289f3f9b07>
{'auction_title': '',
 'color': 'red',
 'currency': 'EUR',
 'doors_number': 5,
 'engine_horse_power': 67,
 'expiration_date': '2026-03-27T16:47:54Z',
 'fuel_type': 'petrol',
 'id': '829152da-c1d4-5d48-9b78-fee07b330c0c',
 'is_damaged': False,
 'is_operable': True,
 'is_vat_deductible': False,
 'is_vat_included': False,
 'link_to_web_offer': 'https://www.auto1.com/en/app/merchant/car/GY66252',
 'listing': 'auction',
 'make': 'Kia',
 'model': 'Picanto',
 'odometer': 60399,
 'odometer_reading_unit': 'km',
 'origin_country_code': 'NL',
 'original_photo_count': 0,
 'price': 0,
 'price_includes_vat': False,
 'registration_date': '2018-02-01',
 'seller_name': None,
 'title': 'Kia Picanto 1.0 Active',
 'transmission': 'manual',
 'trim': 'Active',
 'year': 2018}
2026-03-27 12:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27auto1.nl%27%20and%20RowKey%20eq%20%27GY66252%27 HTTP/1.1" 200 None
2026-03-27 12:12:43 [auto1.nl] INFO: Saving data for GY66252: {'auction_closing_time': 1774630074.0, 'created_time': 1773947546.795203, 'last_price_update_time': 1774613563.777085}
2026-03-27 12:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-27 12:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='auto1.nl',RowKey='GY66252') HTTP/1.1" 204 0
2026-03-27 12:12:43 [auto1.nl] INFO: Channel: 24h | Page: 28 | totalHits: 1061 | hits on page: 0
2026-03-27 12:12:43 [scrapy.core.engine] INFO: Closing spider (finished)
2026-03-27 12:12:43 [auto1.nl] INFO: auto1.nl Batch config: batch 2/2
2026-03-27 12:12:43 [auto1.nl] INFO: auto1.nl Crawl ended with reason finished, scrape types: {<ScrapeType.NEW: 1>: 0, <ScrapeType.NEW_DUPLICATE_ID: 4>: 0, <ScrapeType.PRICE_UPDATE: 2>: 4, <ScrapeType.AUCTION_UPDATE: 3>: 0, <ScrapeType.SKIPPED: 0>: 0, <ScrapeType.BATCH_SKIPPED: 5>: 1}
2026-03-27 12:12:43 [scrapy.extensions.feedexport] INFO: Stored jsonlines feed (167 items) in: file:///var/lib/scrapyd/items/sourcing_v2/auto1.nl/task_28_2026-03-27T12_10_00.jl
2026-03-27 12:12:43 [scrapy.statscollectors] INFO: Dumping Scrapy stats:
{'downloader/request_bytes': 701569,
 'downloader/request_count': 401,
 'downloader/request_method_count/GET': 371,
 'downloader/request_method_count/POST': 30,
 'downloader/response_bytes': 136284306,
 'downloader/response_count': 401,
 'downloader/response_status_count/200': 401,
 'dupefilter/filtered': 17,
 'elapsed_time_seconds': 157.173878,
 'feedexport/success_count/FileFeedStorage': 1,
 'finish_reason': 'finished',
 'finish_time': datetime.datetime(2026, 3, 27, 12, 12, 43, 891308, tzinfo=datetime.timezone.utc),
 'item_scraped_count': 167,
 'log_count/DEBUG': 4791,
 'log_count/INFO': 5144,
 'memusage/max': 198803456,
 'memusage/startup': 149970944,
 'photo_download_count': 267,
 'request_depth_max': 31,
 'response_received_count': 134,
 'scheduler/dequeued': 401,
 'scheduler/dequeued/memory': 401,
 'scheduler/enqueued': 401,
 'scheduler/enqueued/memory': 401,
 'scrape_type/batch_skipped': 551,
 'scrape_type/new': 51,
 'scrape_type/price_update': 116,
 'scrape_type/skipped': 366,
 'scrapy-zyte-api/429': 0,
 'scrapy-zyte-api/attempts': 134,
 'scrapy-zyte-api/error_ratio': 0.0,
 'scrapy-zyte-api/errors': 0,
 'scrapy-zyte-api/fatal_errors': 0,
 'scrapy-zyte-api/mean_connection_seconds': 3.0345921444935984,
 'scrapy-zyte-api/mean_response_seconds': 3.071946269095834,
 'scrapy-zyte-api/processed': 134,
 'scrapy-zyte-api/request_args/customHttpRequestHeaders': 134,
 'scrapy-zyte-api/request_args/experimental.requestCookies': 133,
 'scrapy-zyte-api/request_args/experimental.responseCookies': 134,
 'scrapy-zyte-api/request_args/httpRequestBody': 30,
 'scrapy-zyte-api/request_args/httpRequestMethod': 30,
 'scrapy-zyte-api/request_args/httpResponseBody': 134,
 'scrapy-zyte-api/request_args/httpResponseHeaders': 134,
 'scrapy-zyte-api/request_args/sessionContext': 134,
 'scrapy-zyte-api/request_args/url': 134,
 'scrapy-zyte-api/status_codes/200': 134,
 'scrapy-zyte-api/success': 134,
 'scrapy-zyte-api/success_ratio': 1.0,
 'scrapy-zyte-api/throttle_ratio': 0.0,
 'source/items_encountered': 1101,
 'source/total_available': 1061,
 'start_time': datetime.datetime(2026, 3, 27, 12, 10, 6, 717430, tzinfo=datetime.timezone.utc)}
2026-03-27 12:12:43 [scrapy.core.engine] INFO: Spider closed (finished)
2026-03-27 12:12:44 [asyncio] ERROR: Unclosed client session
client_session: <aiohttp.client.ClientSession object at 0x7f7d0001df10>
2026-03-27 12:12:44 [asyncio] ERROR: Unclosed client session
client_session: <aiohttp.client.ClientSession object at 0x7f7d00168090>